-- Logs begin at Wed 2021-12-15 12:47:23 UTC, end at Wed 2021-12-15 13:56:19 UTC. -- Dec 15 13:22:49.280573 dv-cinder-813227-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 15 13:22:49.290314 dv-cinder-813227-4-iscsi devstack@n-api.service[101679]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 15 13:22:49.291754 dv-cinder-813227-4-iscsi devstack@n-api.service[101679]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Dec 15 13:22:49 2021] *** Dec 15 13:22:49.291754 dv-cinder-813227-4-iscsi devstack@n-api.service[101679]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 15 13:22:49.291754 dv-cinder-813227-4-iscsi devstack@n-api.service[101679]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 15 13:22:49.291754 dv-cinder-813227-4-iscsi devstack@n-api.service[101679]: nodename: dv-cinder-813227-4-iscsi Dec 15 13:22:49.291754 dv-cinder-813227-4-iscsi devstack@n-api.service[101679]: machine: x86_64 Dec 15 13:22:49.291754 dv-cinder-813227-4-iscsi devstack@n-api.service[101679]: clock source: unix Dec 15 13:22:49.291754 dv-cinder-813227-4-iscsi devstack@n-api.service[101679]: pcre jit disabled Dec 15 13:22:49.291754 dv-cinder-813227-4-iscsi devstack@n-api.service[101679]: detected number of CPU cores: 4 Dec 15 13:22:49.291754 dv-cinder-813227-4-iscsi devstack@n-api.service[101679]: current working directory: / Dec 15 13:22:49.291754 dv-cinder-813227-4-iscsi devstack@n-api.service[101679]: detected binary path: /usr/bin/uwsgi-core Dec 15 13:22:49.291754 dv-cinder-813227-4-iscsi devstack@n-api.service[101679]: your processes number limit is 47680 Dec 15 13:22:49.291754 dv-cinder-813227-4-iscsi devstack@n-api.service[101679]: your memory page size is 4096 bytes Dec 15 13:22:49.291754 dv-cinder-813227-4-iscsi devstack@n-api.service[101679]: detected max file descriptor number: 2048 Dec 15 13:22:49.291754 dv-cinder-813227-4-iscsi devstack@n-api.service[101679]: lock engine: pthread robust mutexes Dec 15 13:22:49.291754 dv-cinder-813227-4-iscsi devstack@n-api.service[101679]: thunder lock: enabled Dec 15 13:22:49.293628 dv-cinder-813227-4-iscsi devstack@n-api.service[101679]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 15 13:22:49.293628 dv-cinder-813227-4-iscsi devstack@n-api.service[101679]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Dec 15 13:22:49.335832 dv-cinder-813227-4-iscsi devstack@n-api.service[101679]: Python main interpreter initialized at 0x55771e3ea9c0 Dec 15 13:22:49.335832 dv-cinder-813227-4-iscsi devstack@n-api.service[101679]: python threads support enabled Dec 15 13:22:49.335832 dv-cinder-813227-4-iscsi devstack@n-api.service[101679]: your server socket listen backlog is limited to 100 connections Dec 15 13:22:49.335832 dv-cinder-813227-4-iscsi devstack@n-api.service[101679]: your mercy for graceful operations on workers is 90 seconds Dec 15 13:22:49.336149 dv-cinder-813227-4-iscsi devstack@n-api.service[101679]: mapped 403077 bytes (393 KB) for 2 cores Dec 15 13:22:49.336223 dv-cinder-813227-4-iscsi devstack@n-api.service[101679]: *** Operational MODE: preforking *** Dec 15 13:22:49.336486 dv-cinder-813227-4-iscsi devstack@n-api.service[101679]: *** uWSGI is running in multiple interpreter mode *** Dec 15 13:22:49.336486 dv-cinder-813227-4-iscsi devstack@n-api.service[101679]: spawned uWSGI master process (pid: 101679) Dec 15 13:22:49.336664 dv-cinder-813227-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 15 13:22:49.337398 dv-cinder-813227-4-iscsi devstack@n-api.service[101679]: spawned uWSGI worker 1 (pid: 101680, cores: 1) Dec 15 13:22:49.338121 dv-cinder-813227-4-iscsi devstack@n-api.service[101679]: spawned uWSGI worker 2 (pid: 101681, cores: 1) Dec 15 13:22:49.338121 dv-cinder-813227-4-iscsi devstack@n-api.service[101679]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 15 13:22:51.062406 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 13:22:51.062406 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: from cryptography.utils import int_from_bytes Dec 15 13:22:51.063114 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 13:22:51.063114 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: from cryptography.utils import int_from_bytes Dec 15 13:22:51.065541 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 13:22:51.065541 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: from cryptography.utils import int_from_bytes Dec 15 13:22:51.066004 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 13:22:51.066004 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: from cryptography.utils import int_from_bytes Dec 15 13:22:53.608862 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 15 13:22:53.609394 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 15 13:22:53.609483 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 15 13:22:53.609847 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 15 13:22:53.609929 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 15 13:22:53.610005 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 15 13:22:53.610073 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 15 13:22:53.610148 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 15 13:22:53.610424 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 15 13:22:53.610525 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.610679 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 15 13:22:53.610829 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.611106 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.611195 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.611432 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.611527 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.611752 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.611841 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.612069 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.612154 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.612384 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.612468 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.612694 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.612792 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.613012 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.613098 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.613269 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.613355 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.613578 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.613673 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.613886 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.613971 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813227-4-iscsi {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.614198 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.614283 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.614498 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.614583 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813227-4-iscsi {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.614803 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.614932 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.615680 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.615775 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.616004 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.616092 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.616325 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.616411 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.616629 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.616738 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.616951 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.617118 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.617259 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.617551 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.617770 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.617915 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.618076 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.618189 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.618381 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.618528 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.618691 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.618785 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.619053 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.619202 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.619369 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.619456 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.619675 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.619765 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.619990 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.620126 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.620293 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.620392 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.620611 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.620697 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813227-4-iscsi {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.620922 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.621005 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.621291 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.621377 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813227-4-iscsi {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.621608 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.621764 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.621922 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.622008 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.622237 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.622337 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.622596 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.622774 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.622932 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.623030 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.623252 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.623355 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.623559 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.623646 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.623878 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.623970 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.624187 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.624283 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.624501 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.624586 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.624817 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.624909 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.625115 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.625212 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.625420 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.625506 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.625725 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.625817 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.626035 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.626123 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.626334 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.626418 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.626636 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.626730 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.626903 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.626996 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.627208 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.627293 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.627495 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.627595 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.627818 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.627971 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.628123 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.628211 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.628368 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.628464 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.628617 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.628748 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.628930 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.629079 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.629237 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.629327 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.629539 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.629624 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.629843 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.629931 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.630146 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.630233 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.630449 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.630535 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.630791 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.630897 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.631123 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.631218 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.631426 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.631519 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.631729 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.631824 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.632036 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.632129 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.632340 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.632434 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.632654 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.632751 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.632959 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.633044 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.633274 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.633365 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.633577 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.633674 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.633894 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.633981 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.634194 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.634286 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.634526 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.634628 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.634836 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.634958 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.635163 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.635257 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.635478 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.635566 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.635792 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.635885 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.636095 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.636188 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.636400 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.636495 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.636702 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.636795 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.637010 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.637097 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.637316 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.637411 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.637625 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.637709 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.637871 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.637958 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.638169 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.638259 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.638466 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.638553 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.638764 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.638873 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.639093 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.639180 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.639394 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.639481 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.639696 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.639796 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.639992 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.640086 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.640292 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.640377 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.640590 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.640683 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.640891 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.640976 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.641194 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.641279 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.641496 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.641590 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.641799 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.641893 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.642099 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.642190 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.642401 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.642503 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.642700 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.642785 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.643029 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.643120 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.643337 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.643470 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.643636 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.643721 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.643937 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.644024 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.644239 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.644327 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.644539 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.644638 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.644842 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.644939 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.645144 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.645238 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.645445 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.645541 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.645753 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.645846 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.646053 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.646147 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.646883 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.647034 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.647204 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.647291 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.647510 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.647605 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.647812 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.647898 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.648117 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.648212 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.648415 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.648504 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.648716 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.648801 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.649018 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.649104 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.649318 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.649413 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.649620 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.649706 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.649922 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.650007 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.650223 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.650322 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.650525 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.650620 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.650826 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.650972 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.651145 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.651232 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.651447 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.651534 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.651747 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.651845 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.652047 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.652133 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.652349 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.652471 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.655171 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.655333 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.655449 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.655556 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.655671 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.655801 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.655911 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.656027 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.656027 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.656234 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.656347 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:22:53.656452 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.656565 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.656671 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.656796 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.656904 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.656904 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.657099 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.657216 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.657330 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.657435 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.657561 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.657645 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.657731 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.657820 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.657901 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.657978 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.658064 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.658192 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.658324 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.658410 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.658488 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.658565 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.658649 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.658728 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.658814 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.658923 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.659005 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.659082 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.659159 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.659242 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.659347 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.659440 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.659526 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.659614 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.659694 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.659772 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.659859 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.659940 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.660025 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.660218 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.660306 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.660533 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.660633 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.660839 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.660926 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.661173 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.661261 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.661508 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.661616 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.661822 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.661910 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.662710 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.662814 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.663050 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.663154 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.663409 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.663505 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.663720 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.663814 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.664031 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.664119 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.664340 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.664424 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.664650 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.664737 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.664961 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.665049 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.665267 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.665353 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.665598 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.665684 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.665905 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.665992 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.666213 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.666305 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.666516 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.666603 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.666815 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.666944 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.667139 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.667225 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.667442 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.667540 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.667741 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.667838 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.668048 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.668134 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.668351 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.668451 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.668654 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.668741 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.668978 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.669063 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.669280 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.669378 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.669588 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.669676 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.669892 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.669977 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.670192 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.670286 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.670500 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.670585 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.670803 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.670923 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.671140 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.671229 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.671447 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.671540 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.671752 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.671839 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.672051 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.672184 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.672369 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.672458 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.672669 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.672754 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.672968 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.673062 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.673278 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.673367 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.673581 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.673666 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.673884 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.673979 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.674190 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.674276 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.674495 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.674589 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.674802 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.674916 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.675130 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.675216 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.675441 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.675540 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.675751 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.675839 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.676057 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.676151 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.676379 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.676475 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.676684 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.676778 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.676997 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.677082 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.677298 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.677397 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.677628 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.677752 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.677932 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.678024 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.678230 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.678317 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.678532 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.678621 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.678833 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.678938 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.679154 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.679242 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.679453 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.679539 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.679751 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.679837 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.680051 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.680138 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.680350 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.680444 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.680653 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.681001 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.681212 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.681304 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.681513 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.681599 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.681818 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.681913 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.682116 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.682203 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.682416 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.682501 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.682717 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.682812 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.683086 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.683178 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.683393 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.683486 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.683717 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.683812 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.684038 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.684134 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.684344 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.684438 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.684657 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.684753 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.684966 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.685052 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.685271 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.685363 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.685576 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.685663 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.685884 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.685999 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.686192 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.686314 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.686499 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.686612 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.686813 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.686951 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.687144 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.687259 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.687461 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.687575 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.687839 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.687960 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.688066 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.688171 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.688363 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.688488 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.688674 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.688790 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.688974 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.689093 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.689292 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.689417 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.689626 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.689738 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.689946 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.690070 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.690254 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.690368 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.691031 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.691117 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.691216 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.691306 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.691394 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.691481 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.691561 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.691646 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.691761 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.691851 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.692074 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.692163 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.692379 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.692472 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.692689 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.692776 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.692994 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.693079 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.693345 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.693437 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.693652 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.693747 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.693963 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.694106 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.694265 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.694361 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.694573 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.694662 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.694902 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.694992 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.695219 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.695319 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.695524 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.695609 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.695831 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.695924 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.696146 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.696244 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.696452 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.696539 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.696756 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.696844 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.697062 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.697156 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.697359 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.697453 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.697660 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.697748 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.697962 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.698068 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.698266 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.698353 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.698569 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.698656 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.698894 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.698997 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.699198 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.699285 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.699505 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.699590 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.699808 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.699896 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.700106 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.700193 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.700470 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.700569 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.700703 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.700797 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.701009 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.701096 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.701310 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.701413 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.701628 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.701713 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.701938 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.702025 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.702237 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.702336 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.702537 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.702631 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.702865 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.702954 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.703180 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.703279 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.703480 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.703575 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.703779 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.703867 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.704080 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.704225 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.704382 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.704476 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.704689 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.704776 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.705007 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.705139 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.705320 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.705418 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.705621 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.705714 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.705929 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.706032 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.706240 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.706335 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.706547 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.706639 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.706877 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.706972 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.707183 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.707277 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.707489 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.707573 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.707789 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.707883 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.708096 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.708195 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.708400 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.708493 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.708703 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.708789 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.709520 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.709680 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.709831 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.709930 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.710136 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.710221 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.710441 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.710547 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.710749 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.710876 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.711073 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.711160 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.711382 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.711470 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.711691 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.711788 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.712000 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.712268 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.712355 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.712598 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.712869 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.712957 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.713203 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.713294 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.713517 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.713602 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.713833 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.713919 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.714151 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.714250 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.714473 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.714577 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.714778 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.714890 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.715108 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.715193 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.715415 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.715501 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.715717 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.715815 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.716017 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.716103 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.716325 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.716417 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.716623 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.716720 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.716923 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.717024 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.717225 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.717328 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.717526 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.717611 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.717823 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.717907 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.718123 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.718227 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.718424 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.718508 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.718730 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.718816 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.719063 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.719159 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.719364 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.719451 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.719675 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.719770 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.719974 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.720074 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.720284 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.720391 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.720586 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.720671 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.720888 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.720994 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.721184 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.721279 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.721480 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.721565 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.721784 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.721870 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.722087 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.722182 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.722429 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.722516 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.722738 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.722824 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.723100 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.723188 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.723406 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.723500 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.723710 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.723828 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.724091 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.724182 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.724321 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.724423 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.725261 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.725350 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.725467 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.725592 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.725778 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.725869 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.726083 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.726169 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.726380 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.726469 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.726686 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.726773 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.727014 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.727118 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.727322 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.727409 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.727630 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.727717 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.727931 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.728027 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.728240 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.728366 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.728541 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.728634 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.728849 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.728998 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.729161 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.729291 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.729439 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.729524 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.729739 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.729834 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.730042 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.730135 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.730345 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.730431 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.730645 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.730739 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.730976 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.731075 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.731276 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.731365 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.731588 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.731676 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.731892 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.731975 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.732196 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.732307 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.732498 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.732591 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.732801 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.732891 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.733106 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.733191 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.733409 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.733496 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.733718 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.733809 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.734021 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.734114 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.734323 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.734410 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.734623 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.734712 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.734949 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.735053 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.735251 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.735337 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.735549 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.735650 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.735852 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.735947 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.736157 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.736252 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.736466 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.736551 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.736765 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.736860 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.737072 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.737157 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.737372 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.737457 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.737673 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.737767 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.737972 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.738057 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.738274 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.738359 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.738570 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.738706 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.738888 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.739028 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.739192 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.739340 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.739481 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.739611 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.739779 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.739912 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.740098 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.740236 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.740412 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.740546 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.740712 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.740853 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.741012 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.741115 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.741306 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.741399 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.741618 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.741702 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.741920 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.742014 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.742265 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.742350 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.742565 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.742657 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.742896 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.743012 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.743210 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.743305 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.743516 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.743603 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.743822 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.743917 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.744130 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.744215 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.744431 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.744524 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.744741 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.744830 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.745042 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.745126 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.745348 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.745433 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.745647 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.745733 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.745947 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.746034 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.746247 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.746330 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.746551 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.746639 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.746870 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.746956 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.747188 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.747275 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.747495 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.747580 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.747807 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.747899 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.748109 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.748203 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.748414 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.748544 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.748718 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.748804 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.749024 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.749120 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.749325 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.749410 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.749629 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.749719 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.749931 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.750024 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.750237 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.750328 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.750539 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.750630 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.750860 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.750961 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.751168 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.751256 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.751470 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.751556 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.751775 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.751871 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.752081 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.752167 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.752380 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.752463 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.752686 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.752773 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.752989 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.753075 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.753285 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.753378 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.753590 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.753677 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.753887 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.753973 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.754190 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.754282 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.754489 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.754574 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.754796 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.754940 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.755124 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.755210 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.755520 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.755606 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.755846 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.755937 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.756152 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.756251 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.756457 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.756544 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.756763 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.756848 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.757071 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.757167 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.757373 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.757465 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.757683 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.757768 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.757986 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.758084 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.758367 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.758452 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.758673 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.758758 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.758996 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.759098 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.759298 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.759384 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.759600 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.759691 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.759904 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.759990 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.760204 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.760287 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.760503 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.760588 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.760802 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.760895 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.761104 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.761196 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.761407 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.761501 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.761724 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.761819 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.762024 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.762135 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.762346 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.762430 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.762730 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.762816 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.763095 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.763194 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.763401 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.763496 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.763757 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.763842 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.764076 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.764162 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.764394 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.764488 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.764712 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.764805 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.765015 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.765104 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.765325 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.765420 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.765634 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.765718 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.765948 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.766035 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.766262 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.766356 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.766565 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.766656 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.766900 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.766991 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.767204 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.767292 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.767524 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.767609 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.767830 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.767923 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.768136 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.768229 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.768453 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.768538 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.768764 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.768846 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.769087 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.769182 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.769455 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.769564 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.769773 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.769860 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.770096 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.770183 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.770398 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.770492 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.770699 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.770785 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.771031 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.771118 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.771897 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.771996 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.772147 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.772241 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.772454 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.772547 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.772760 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.772846 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.773064 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.773148 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.773370 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.773469 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.773676 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.773767 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.773976 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.774063 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.774276 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.774371 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.774578 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.774662 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.774915 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.775034 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.775227 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.775340 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.775529 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.775617 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.775843 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.775937 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.776155 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.776249 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.776454 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.776541 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.776772 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.776859 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.777076 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.777164 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.777372 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.777466 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.777672 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.777766 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.777969 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.778055 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.778305 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.778400 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.778578 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.778674 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.778919 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.779020 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.779232 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.779320 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.779553 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.779650 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.779860 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.779948 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.780185 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.780273 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.780493 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.780594 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.780802 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.780890 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.781113 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.781202 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.781431 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.781529 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.781728 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.781823 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.782026 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.782127 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.782328 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.782428 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.782632 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.782736 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.782956 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.783054 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.783257 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.783346 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.783556 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.783645 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.783852 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.783947 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.784150 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.784247 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.784449 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.784534 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.784751 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.784840 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.785047 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.785136 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.785365 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.785472 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.785665 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.785751 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.785961 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.786056 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.786260 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.786348 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.786557 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.786653 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.786878 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.786968 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.787738 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.787837 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.788075 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.788179 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.788378 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.788466 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.788695 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.788781 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.789017 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.789127 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.789322 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.789419 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.789642 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.789731 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.789951 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.790050 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.790259 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.790354 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.790570 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.790659 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.790897 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.790989 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.791208 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.791296 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.791516 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.791604 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.791825 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.791915 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.792132 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.792232 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.792440 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.792528 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.792748 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.792838 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.793058 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.793152 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.793372 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.793570 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.793686 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.793892 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.794191 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.794286 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.794497 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.794600 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.794803 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.794926 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.795136 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.795231 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.795444 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.795600 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.795736 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.795871 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.796041 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.796184 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.796347 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.796490 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.796653 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.796793 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.796958 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.797092 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.797269 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.797406 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.797583 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.797725 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.797901 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.798036 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.798208 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.798350 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.798518 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.798652 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.798828 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.798981 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.799155 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.799246 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.799475 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.799560 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.799791 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.799927 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.800090 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.800176 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.800397 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.800483 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.800707 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.800794 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.801013 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.801098 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.801317 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.801403 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.801621 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.801715 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.801929 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.802015 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.802236 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.802332 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.802542 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.802630 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.802894 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.803013 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.803207 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.803305 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.803510 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.803600 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.803821 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.803915 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.804133 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.804237 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.804444 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.804532 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.804750 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.804848 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.805059 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.805221 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.805368 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.805472 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.805681 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.806131 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.806247 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.806442 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.806762 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.806863 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.807104 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.807203 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.807424 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.807514 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.807736 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.807822 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.808044 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.808138 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.808356 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.808443 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.808653 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.808738 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.808951 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.809039 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.809260 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.809374 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.809561 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.809648 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.809856 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.809946 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.810164 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.810252 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.810466 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.810553 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.810760 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.810902 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.811099 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.811188 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.811403 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.811491 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.811721 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.811922 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.812019 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.812263 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.812550 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.812641 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.812889 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.812986 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.813207 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.813293 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.813515 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.813650 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.813819 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.813908 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.814138 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.814226 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.814441 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.814528 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.814742 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.814831 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.815076 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.815164 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.815381 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.815467 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.815730 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.815830 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.815973 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.816062 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.816282 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.816368 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.816585 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.816673 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.816885 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.816983 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.817191 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.817290 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.817485 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.817581 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.817793 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.817880 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.818092 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.818189 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.818418 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.818506 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.818719 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.818806 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.819048 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.819167 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.819348 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.819438 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.819648 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.819736 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.819947 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.820058 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.820248 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.820352 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.820547 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.820634 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.820844 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.821113 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.821212 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.821294 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.821439 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.821528 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.821743 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.821833 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.822044 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.822131 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.822350 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.822487 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.822653 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.822742 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.822984 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.823075 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.823282 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.823418 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.823582 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.823672 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.823892 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.823997 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.824192 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.824285 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.824508 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.824605 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.824816 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.824902 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.825119 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.825214 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.825438 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.825525 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.825749 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.825894 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.826093 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.826270 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.826409 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.826643 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.826970 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.827062 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.827313 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.827417 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.827646 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.827734 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.827951 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.828038 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.828253 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.828420 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.828553 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.828641 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.828873 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.828961 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.829181 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.829292 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.829491 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.829588 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.829797 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.829887 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.830104 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.830193 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.830409 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.830498 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.830714 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.830802 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.831045 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.831144 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.831351 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.831441 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.831660 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.831756 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.831966 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.832061 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.832277 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.832364 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.832593 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.832689 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.832902 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.832989 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.833215 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.833306 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.833528 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.833626 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.833834 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.834432 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.834663 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.834751 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.834996 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.835089 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.835303 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.835391 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.835611 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.835708 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.835922 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.836013 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.836232 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.836319 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.836536 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.836623 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.836859 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.836947 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.837166 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.837256 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.837540 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.837636 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.837857 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.837956 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.838166 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.838255 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.838484 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.838587 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.838793 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.838894 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.839121 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.839216 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.839439 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.839536 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.839745 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.839837 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.840069 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.840165 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.840379 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.840468 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.840709 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.840797 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.841024 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.841112 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.841328 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.841419 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.841630 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.841717 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.841930 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.842028 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.842238 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.842327 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.842551 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.842675 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.842906 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.843000 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.843206 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.843295 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.843523 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.843611 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.843828 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.843961 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.844147 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.844242 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.844451 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.844538 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.844768 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.844868 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.845077 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.845173 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.845385 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.845481 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.845690 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.845788 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.846003 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.846133 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.846306 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.846402 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.846613 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.846703 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.846946 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.847038 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.847254 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.847356 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.847560 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.847651 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.847863 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.847960 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.848171 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.848258 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.848483 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.848572 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.848783 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.848873 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.849102 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.849191 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.849405 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.849492 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.850259 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.850362 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.850573 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.850671 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.850901 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.851015 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.851219 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.851306 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.851522 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.851617 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.851833 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.851922 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.852138 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.852228 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.852443 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.852540 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.852749 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.852836 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.853056 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.853143 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.853368 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.853464 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.853684 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.853782 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.854000 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.854097 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.854320 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.854410 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.854639 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.854733 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.854985 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.855078 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.855325 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.855415 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.855633 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.855720 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.855943 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.856040 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.856250 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.856348 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.856550 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.856638 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.856789 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 15 13:22:53.856887 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.857175 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:22:53.857418 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 15 13:22:53.879802 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG oslo_db.sqlalchemy.engines [None req-975de875-ba4e-497e-8b46-91064973799c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101681) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 13:22:53.880750 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG oslo_db.sqlalchemy.engines [None req-79679f2e-2813-4f1c-acff-f92d21b25dd5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101680) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 13:22:53.945010 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.context [None req-975de875-ba4e-497e-8b46-91064973799c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b8caafff-75e8-4b27-be31-cfd5761b7f9e(cell1) {{(pid=101681) load_cells /opt/stack/nova/nova/context.py:464}} Dec 15 13:22:53.946122 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.context [None req-79679f2e-2813-4f1c-acff-f92d21b25dd5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b8caafff-75e8-4b27-be31-cfd5761b7f9e(cell1) {{(pid=101680) load_cells /opt/stack/nova/nova/context.py:464}} Dec 15 13:22:53.949279 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG oslo_concurrency.lockutils [None req-975de875-ba4e-497e-8b46-91064973799c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:22:53.950354 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG oslo_concurrency.lockutils [None req-79679f2e-2813-4f1c-acff-f92d21b25dd5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:22:53.950840 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG oslo_concurrency.lockutils [None req-975de875-ba4e-497e-8b46-91064973799c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:22:53.951674 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG oslo_concurrency.lockutils [None req-975de875-ba4e-497e-8b46-91064973799c None None] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:22:53.951965 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG oslo_concurrency.lockutils [None req-79679f2e-2813-4f1c-acff-f92d21b25dd5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:22:53.952766 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG oslo_concurrency.lockutils [None req-79679f2e-2813-4f1c-acff-f92d21b25dd5 None None] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:22:53.953609 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG oslo_concurrency.lockutils [None req-975de875-ba4e-497e-8b46-91064973799c None None] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:22:53.954694 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG oslo_concurrency.lockutils [None req-79679f2e-2813-4f1c-acff-f92d21b25dd5 None None] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:22:53.964489 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG oslo_db.sqlalchemy.engines [None req-975de875-ba4e-497e-8b46-91064973799c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101681) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 13:22:53.966914 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG oslo_db.sqlalchemy.engines [None req-975de875-ba4e-497e-8b46-91064973799c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101681) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 13:22:53.971154 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG oslo_db.sqlalchemy.engines [None req-79679f2e-2813-4f1c-acff-f92d21b25dd5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101680) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 13:22:53.973357 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG oslo_db.sqlalchemy.engines [None req-79679f2e-2813-4f1c-acff-f92d21b25dd5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101680) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 13:22:54.130132 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG oslo_db.sqlalchemy.engines [None req-975de875-ba4e-497e-8b46-91064973799c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101681) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 13:22:54.133394 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG oslo_db.sqlalchemy.engines [None req-79679f2e-2813-4f1c-acff-f92d21b25dd5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101680) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 13:22:54.476199 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: WARNING keystonemiddleware.auth_token [None req-79679f2e-2813-4f1c-acff-f92d21b25dd5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 13:22:54.482373 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: WARNING keystonemiddleware.auth_token [None req-975de875-ba4e-497e-8b46-91064973799c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 13:22:54.482812 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: WARNING keystonemiddleware.auth_token [None req-79679f2e-2813-4f1c-acff-f92d21b25dd5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 13:22:54.488968 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: WARNING keystonemiddleware.auth_token [None req-975de875-ba4e-497e-8b46-91064973799c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 13:22:54.823344 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: WARNING keystonemiddleware.auth_token [None req-79679f2e-2813-4f1c-acff-f92d21b25dd5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 13:22:54.826584 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: WARNING keystonemiddleware.auth_token [None req-975de875-ba4e-497e-8b46-91064973799c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 13:22:54.828557 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: WARNING keystonemiddleware.auth_token [None req-79679f2e-2813-4f1c-acff-f92d21b25dd5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 13:22:54.831870 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: WARNING keystonemiddleware.auth_token [None req-975de875-ba4e-497e-8b46-91064973799c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 13:22:54.833705 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55771e3ea9c0 pid: 101680 (default app) Dec 15 13:22:54.835818 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi [None req-79679f2e-2813-4f1c-acff-f92d21b25dd5 None None] Calling method '>' {{(pid=101680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:22:54.836915 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55771e3ea9c0 pid: 101681 (default app) Dec 15 13:22:54.837014 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: INFO nova.api.openstack.requestlog [None req-79679f2e-2813-4f1c-acff-f92d21b25dd5 None None] 10.222.0.60 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001744 Dec 15 13:22:54.837376 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: [pid: 101680|app: 0|req: 1/1] 10.222.0.60 () {50 vars in 788 bytes} [Wed Dec 15 13:22:54 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:24:16.493928 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi [None req-975de875-ba4e-497e-8b46-91064973799c None None] Calling method '>' {{(pid=101681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:24:16.495213 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: INFO nova.api.openstack.requestlog [None req-975de875-ba4e-497e-8b46-91064973799c None None] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001936 Dec 15 13:24:16.495804 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: [pid: 101681|app: 0|req: 1/2] 10.222.0.60 () {54 vars in 930 bytes} [Wed Dec 15 13:24:16 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:24:16.934175 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi [None req-50f9bd8e-a06a-4888-b9fd-ef7958111f90 admin admin] Calling method '>' {{(pid=101680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:24:16.971271 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: INFO nova.api.openstack.requestlog [None req-50f9bd8e-a06a-4888-b9fd-ef7958111f90 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.468971 Dec 15 13:24:16.974131 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: [pid: 101680|app: 0|req: 2/3] 10.222.0.60 () {60 vars in 1291 bytes} [Wed Dec 15 13:24:16 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:24:19.385202 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi [None req-975de875-ba4e-497e-8b46-91064973799c None None] Calling method '>' {{(pid=101681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:24:19.386206 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: INFO nova.api.openstack.requestlog [None req-975de875-ba4e-497e-8b46-91064973799c None None] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Dec 15 13:24:19.386770 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: [pid: 101681|app: 0|req: 2/4] 10.222.0.60 () {54 vars in 930 bytes} [Wed Dec 15 13:24:19 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:24:19.449150 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi [None req-307c7e65-c338-4310-922d-8114ff84d107 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "ram": 256, "disk": 1, "vcpus": 1}} {{(pid=101680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:24:19.468420 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:24:19.468420 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: warnings.warn(msg) Dec 15 13:24:19.500277 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: INFO nova.api.openstack.requestlog [None req-307c7e65-c338-4310-922d-8114ff84d107 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.106508 Dec 15 13:24:19.502032 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: [pid: 101680|app: 0|req: 3/5] 10.222.0.60 () {64 vars in 1282 bytes} [Wed Dec 15 13:24:19 2021] POST /compute/v2.1/flavors => generated 407 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:24:19.717169 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi [None req-9496bb6a-0cc5-4e74-af81-eaf856ef0e88 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:24:19.720449 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:24:19.720449 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: warnings.warn(msg) Dec 15 13:24:19.768737 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: INFO nova.api.openstack.requestlog [None req-9496bb6a-0cc5-4e74-af81-eaf856ef0e88 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.258723 Dec 15 13:24:19.769352 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: [pid: 101681|app: 0|req: 3/6] 10.222.0.60 () {64 vars in 1335 bytes} [Wed Dec 15 13:24:19 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:24:22.186279 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi [None req-307c7e65-c338-4310-922d-8114ff84d107 admin admin] Calling method '>' {{(pid=101680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:24:22.187381 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: INFO nova.api.openstack.requestlog [None req-307c7e65-c338-4310-922d-8114ff84d107 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001544 Dec 15 13:24:22.187972 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: [pid: 101680|app: 0|req: 4/7] 10.222.0.60 () {54 vars in 930 bytes} [Wed Dec 15 13:24:22 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:24:22.315462 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi [None req-8db41e13-3f1e-45b1-9b26-2894bb2c15dc admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "swap": 0, "disk": 5, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "ram": 512, "name": "ds512M"}} {{(pid=101681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:24:22.337495 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:24:22.337495 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: warnings.warn(msg) Dec 15 13:24:22.358602 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: INFO nova.api.openstack.requestlog [None req-8db41e13-3f1e-45b1-9b26-2894bb2c15dc admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.163290 Dec 15 13:24:22.359141 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: [pid: 101681|app: 0|req: 4/8] 10.222.0.60 () {64 vars in 1282 bytes} [Wed Dec 15 13:24:22 2021] POST /compute/v2.1/flavors => generated 404 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:24:22.373925 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi [None req-0684713e-0165-4e3e-9089-97efeb0fc131 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:24:22.375810 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:24:22.375810 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: warnings.warn(msg) Dec 15 13:24:22.416745 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: INFO nova.api.openstack.requestlog [None req-0684713e-0165-4e3e-9089-97efeb0fc131 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047244 Dec 15 13:24:22.417584 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: [pid: 101680|app: 0|req: 5/9] 10.222.0.60 () {64 vars in 1335 bytes} [Wed Dec 15 13:24:22 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:24:24.843230 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi [None req-8db41e13-3f1e-45b1-9b26-2894bb2c15dc admin admin] Calling method '>' {{(pid=101681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:24:24.844280 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: INFO nova.api.openstack.requestlog [None req-8db41e13-3f1e-45b1-9b26-2894bb2c15dc admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001540 Dec 15 13:24:24.850765 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: [pid: 101681|app: 0|req: 5/10] 10.222.0.60 () {54 vars in 930 bytes} [Wed Dec 15 13:24:24 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:24:24.906752 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi [None req-ceb2402f-c281-45c5-9587-747f01f06823 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 1024, "swap": 0, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "name": "ds1G", "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=101680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:24:24.927061 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: INFO nova.api.openstack.requestlog [None req-ceb2402f-c281-45c5-9587-747f01f06823 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075281 Dec 15 13:24:24.932471 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: [pid: 101680|app: 0|req: 6/11] 10.222.0.60 () {64 vars in 1282 bytes} [Wed Dec 15 13:24:24 2021] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:24:24.939908 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi [None req-1eac0355-49cd-45e7-ba31-f8c500b59ebb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:24:24.962951 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: INFO nova.api.openstack.requestlog [None req-1eac0355-49cd-45e7-ba31-f8c500b59ebb admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026541 Dec 15 13:24:24.972823 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: [pid: 101681|app: 0|req: 6/12] 10.222.0.60 () {64 vars in 1335 bytes} [Wed Dec 15 13:24:24 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:24:27.351578 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi [None req-ceb2402f-c281-45c5-9587-747f01f06823 admin admin] Calling method '>' {{(pid=101680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:24:27.352574 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: INFO nova.api.openstack.requestlog [None req-ceb2402f-c281-45c5-9587-747f01f06823 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Dec 15 13:24:27.352964 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: [pid: 101680|app: 0|req: 7/13] 10.222.0.60 () {54 vars in 930 bytes} [Wed Dec 15 13:24:27 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:24:27.412420 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi [None req-1956d39b-28f6-47b0-9496-58e66669088f admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds2G", "ram": 2048, "vcpus": 2, "id": "d3"}} {{(pid=101681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:24:27.430677 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: INFO nova.api.openstack.requestlog [None req-1956d39b-28f6-47b0-9496-58e66669088f admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071152 Dec 15 13:24:27.431262 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: [pid: 101681|app: 0|req: 7/14] 10.222.0.60 () {64 vars in 1282 bytes} [Wed Dec 15 13:24:27 2021] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:24:27.443356 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi [None req-dfdfae48-27e9-4d56-a3b3-d8c451832380 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:24:27.465632 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: INFO nova.api.openstack.requestlog [None req-dfdfae48-27e9-4d56-a3b3-d8c451832380 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025866 Dec 15 13:24:27.467620 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: [pid: 101680|app: 0|req: 8/15] 10.222.0.60 () {64 vars in 1335 bytes} [Wed Dec 15 13:24:27 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:24:29.895103 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi [None req-1956d39b-28f6-47b0-9496-58e66669088f admin admin] Calling method '>' {{(pid=101681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:24:29.896095 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: INFO nova.api.openstack.requestlog [None req-1956d39b-28f6-47b0-9496-58e66669088f admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Dec 15 13:24:29.896666 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: [pid: 101681|app: 0|req: 8/16] 10.222.0.60 () {54 vars in 930 bytes} [Wed Dec 15 13:24:29 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:24:29.956755 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi [None req-5cef6b40-3db7-49d1-8cca-57dd5b334156 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 4, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 20, "swap": 0, "id": "d4", "name": "ds4G"}} {{(pid=101680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:24:29.975941 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: INFO nova.api.openstack.requestlog [None req-5cef6b40-3db7-49d1-8cca-57dd5b334156 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072527 Dec 15 13:24:29.978964 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: [pid: 101680|app: 0|req: 9/17] 10.222.0.60 () {64 vars in 1282 bytes} [Wed Dec 15 13:24:29 2021] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:24:29.989456 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi [None req-a577f194-dd08-4638-9798-cfe82676d5c2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:24:30.012064 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: INFO nova.api.openstack.requestlog [None req-a577f194-dd08-4638-9798-cfe82676d5c2 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026909 Dec 15 13:24:30.012612 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: [pid: 101681|app: 0|req: 9/18] 10.222.0.60 () {64 vars in 1335 bytes} [Wed Dec 15 13:24:29 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:24:32.462092 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi [None req-5cef6b40-3db7-49d1-8cca-57dd5b334156 admin admin] Calling method '>' {{(pid=101680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:24:32.463129 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: INFO nova.api.openstack.requestlog [None req-5cef6b40-3db7-49d1-8cca-57dd5b334156 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Dec 15 13:24:32.463772 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: [pid: 101680|app: 0|req: 10/19] 10.222.0.60 () {54 vars in 930 bytes} [Wed Dec 15 13:24:32 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:24:32.522665 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi [None req-6461e119-f94c-4924-a7bd-1d212ae1d89f admin admin] Calling method '>' {{(pid=101681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:24:32.546075 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: INFO nova.api.openstack.requestlog [None req-6461e119-f94c-4924-a7bd-1d212ae1d89f admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.076035 Dec 15 13:24:32.546619 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: [pid: 101681|app: 0|req: 10/20] 10.222.0.60 () {60 vars in 1291 bytes} [Wed Dec 15 13:24:32 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:24:35.351079 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi [None req-5cef6b40-3db7-49d1-8cca-57dd5b334156 admin admin] Calling method '>' {{(pid=101680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:24:35.352087 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: INFO nova.api.openstack.requestlog [None req-5cef6b40-3db7-49d1-8cca-57dd5b334156 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Dec 15 13:24:35.352495 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: [pid: 101680|app: 0|req: 11/21] 10.222.0.60 () {54 vars in 930 bytes} [Wed Dec 15 13:24:35 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:24:35.412627 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi [None req-c00a0f85-feb3-4637-8bb5-22138a78d5a6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "1", "ram": 512, "vcpus": 1, "name": "m1.tiny", "disk": 1, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:24:35.433982 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: INFO nova.api.openstack.requestlog [None req-c00a0f85-feb3-4637-8bb5-22138a78d5a6 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.074939 Dec 15 13:24:35.434662 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: [pid: 101681|app: 0|req: 11/22] 10.222.0.60 () {64 vars in 1282 bytes} [Wed Dec 15 13:24:35 2021] POST /compute/v2.1/flavors => generated 402 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:24:35.450158 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi [None req-5f33147d-3f76-4101-a96e-18a08544bae3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:24:35.476678 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: INFO nova.api.openstack.requestlog [None req-5f33147d-3f76-4101-a96e-18a08544bae3 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030833 Dec 15 13:24:35.477505 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: [pid: 101680|app: 0|req: 12/23] 10.222.0.60 () {64 vars in 1332 bytes} [Wed Dec 15 13:24:35 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:24:37.897883 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi [None req-c00a0f85-feb3-4637-8bb5-22138a78d5a6 admin admin] Calling method '>' {{(pid=101681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:24:37.899079 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: INFO nova.api.openstack.requestlog [None req-c00a0f85-feb3-4637-8bb5-22138a78d5a6 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001610 Dec 15 13:24:37.899575 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: [pid: 101681|app: 0|req: 12/24] 10.222.0.60 () {54 vars in 930 bytes} [Wed Dec 15 13:24:37 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:24:37.957735 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi [None req-e8879b74-4379-4956-8027-bf5c886c7838 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "id": "2", "name": "m1.small", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "disk": 20}} {{(pid=101680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:24:37.974779 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: INFO nova.api.openstack.requestlog [None req-e8879b74-4379-4956-8027-bf5c886c7838 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.068838 Dec 15 13:24:37.975624 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: [pid: 101680|app: 0|req: 13/25] 10.222.0.60 () {64 vars in 1282 bytes} [Wed Dec 15 13:24:37 2021] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:24:37.987885 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi [None req-8f93c7d8-a742-4b93-92d7-8d203d8811df admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:24:38.009320 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: INFO nova.api.openstack.requestlog [None req-8f93c7d8-a742-4b93-92d7-8d203d8811df admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025639 Dec 15 13:24:38.010051 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: [pid: 101681|app: 0|req: 13/26] 10.222.0.60 () {64 vars in 1332 bytes} [Wed Dec 15 13:24:37 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:24:40.395093 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi [None req-e8879b74-4379-4956-8027-bf5c886c7838 admin admin] Calling method '>' {{(pid=101680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:24:40.396100 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: INFO nova.api.openstack.requestlog [None req-e8879b74-4379-4956-8027-bf5c886c7838 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001584 Dec 15 13:24:40.396501 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: [pid: 101680|app: 0|req: 14/27] 10.222.0.60 () {54 vars in 930 bytes} [Wed Dec 15 13:24:40 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:24:40.455027 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi [None req-f0cf874d-5abb-4174-ade6-73ee6a42d073 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.medium", "os-flavor-access:is_public": true, "id": "3", "disk": 40, "ram": 4096, "rxtx_factor": 1.0, "vcpus": 2}} {{(pid=101681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:24:40.472623 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: INFO nova.api.openstack.requestlog [None req-f0cf874d-5abb-4174-ade6-73ee6a42d073 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.069819 Dec 15 13:24:40.473175 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: [pid: 101681|app: 0|req: 14/28] 10.222.0.60 () {64 vars in 1282 bytes} [Wed Dec 15 13:24:40 2021] POST /compute/v2.1/flavors => generated 406 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:24:40.485133 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi [None req-633a379c-8770-4117-a2d5-5f876a871f68 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:24:40.509561 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: INFO nova.api.openstack.requestlog [None req-633a379c-8770-4117-a2d5-5f876a871f68 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027959 Dec 15 13:24:40.510125 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: [pid: 101680|app: 0|req: 15/29] 10.222.0.60 () {64 vars in 1332 bytes} [Wed Dec 15 13:24:40 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:24:42.918071 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi [None req-f0cf874d-5abb-4174-ade6-73ee6a42d073 admin admin] Calling method '>' {{(pid=101681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:24:42.919796 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: INFO nova.api.openstack.requestlog [None req-f0cf874d-5abb-4174-ade6-73ee6a42d073 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002154 Dec 15 13:24:42.920192 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: [pid: 101681|app: 0|req: 15/30] 10.222.0.60 () {54 vars in 930 bytes} [Wed Dec 15 13:24:42 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:24:42.980191 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi [None req-207f73e1-cfb7-4655-909c-d4e851c20973 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "ram": 8192, "rxtx_factor": 1.0, "name": "m1.large", "disk": 80, "vcpus": 4}} {{(pid=101680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:24:42.999608 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: INFO nova.api.openstack.requestlog [None req-207f73e1-cfb7-4655-909c-d4e851c20973 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.072547 Dec 15 13:24:43.000252 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: [pid: 101680|app: 0|req: 16/31] 10.222.0.60 () {64 vars in 1282 bytes} [Wed Dec 15 13:24:42 2021] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:24:43.012615 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi [None req-e264ac97-8568-43e2-abb7-eea82c0d2d7e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:24:43.037649 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: INFO nova.api.openstack.requestlog [None req-e264ac97-8568-43e2-abb7-eea82c0d2d7e admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028717 Dec 15 13:24:43.039750 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: [pid: 101681|app: 0|req: 16/32] 10.222.0.60 () {64 vars in 1332 bytes} [Wed Dec 15 13:24:43 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:24:45.487733 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi [None req-207f73e1-cfb7-4655-909c-d4e851c20973 admin admin] Calling method '>' {{(pid=101680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:24:45.489457 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: INFO nova.api.openstack.requestlog [None req-207f73e1-cfb7-4655-909c-d4e851c20973 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002166 Dec 15 13:24:45.498917 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: [pid: 101680|app: 0|req: 17/33] 10.222.0.60 () {54 vars in 930 bytes} [Wed Dec 15 13:24:45 2021] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:24:45.552260 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi [None req-715c0658-4f01-4842-b0d0-9325d9a21af9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "name": "m1.xlarge", "os-flavor-access:is_public": true, "disk": 160, "rxtx_factor": 1.0, "id": "5"}} {{(pid=101681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:24:45.572749 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: INFO nova.api.openstack.requestlog [None req-715c0658-4f01-4842-b0d0-9325d9a21af9 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.075910 Dec 15 13:24:45.579299 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: [pid: 101681|app: 0|req: 17/34] 10.222.0.60 () {64 vars in 1282 bytes} [Wed Dec 15 13:24:45 2021] POST /compute/v2.1/flavors => generated 408 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:24:45.585298 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi [None req-dfbcd84c-15b3-459d-9cb2-776bad2c83ea admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:24:45.616172 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: INFO nova.api.openstack.requestlog [None req-dfbcd84c-15b3-459d-9cb2-776bad2c83ea admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033415 Dec 15 13:24:45.635322 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: [pid: 101680|app: 0|req: 18/35] 10.222.0.60 () {64 vars in 1332 bytes} [Wed Dec 15 13:24:45 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:25:06.584316 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi [None req-715c0658-4f01-4842-b0d0-9325d9a21af9 admin admin] Calling method '>' {{(pid=101681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:25:06.585362 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: INFO nova.api.openstack.requestlog [None req-715c0658-4f01-4842-b0d0-9325d9a21af9 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Dec 15 13:25:06.585757 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: [pid: 101681|app: 0|req: 18/36] 10.222.0.60 () {54 vars in 930 bytes} [Wed Dec 15 13:25:06 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:25:06.643071 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi [None req-b1823991-d502-44a6-a1b6-661b8981babc admin admin] Calling method '>' {{(pid=101680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:25:06.660112 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: INFO nova.api.openstack.requestlog [None req-b1823991-d502-44a6-a1b6-661b8981babc admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.067789 Dec 15 13:25:06.660644 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: [pid: 101680|app: 0|req: 19/37] 10.222.0.60 () {60 vars in 1291 bytes} [Wed Dec 15 13:25:06 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:25:08.250017 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi [None req-715c0658-4f01-4842-b0d0-9325d9a21af9 admin admin] Calling method '>' {{(pid=101681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:25:08.251032 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: INFO nova.api.openstack.requestlog [None req-715c0658-4f01-4842-b0d0-9325d9a21af9 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Dec 15 13:25:08.251423 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: [pid: 101681|app: 0|req: 19/38] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Dec 15 13:25:08 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:25:08.439968 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi [None req-11a1d0a7-05bd-4f42-889c-325fc814f882 admin admin] Calling method '>' {{(pid=101680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:25:08.445305 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: INFO nova.api.openstack.wsgi [None req-11a1d0a7-05bd-4f42-889c-325fc814f882 admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 15 13:25:08.445857 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi [None req-11a1d0a7-05bd-4f42-889c-325fc814f882 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:25:08.446663 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: INFO nova.api.openstack.requestlog [None req-11a1d0a7-05bd-4f42-889c-325fc814f882 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.057474 Dec 15 13:25:08.447222 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: [pid: 101680|app: 0|req: 20/39] 10.222.0.60 () {60 vars in 1190 bytes} [Wed Dec 15 13:25:08 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 13:25:08.457361 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi [None req-df94c3a8-5b40-45ee-aac8-c9a6d75f0ab6 admin admin] Calling method '>' {{(pid=101681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:25:08.477181 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: INFO nova.api.openstack.requestlog [None req-df94c3a8-5b40-45ee-aac8-c9a6d75f0ab6 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023265 Dec 15 13:25:08.477698 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: [pid: 101681|app: 0|req: 20/40] 10.222.0.60 () {60 vars in 1210 bytes} [Wed Dec 15 13:25:08 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:25:08.487693 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi [None req-6d594ddc-b0a1-4d53-bb2f-4a8b3b4a597c admin admin] Calling method '>' {{(pid=101680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:25:08.508495 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: INFO nova.api.openstack.requestlog [None req-6d594ddc-b0a1-4d53-bb2f-4a8b3b4a597c admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024402 Dec 15 13:25:08.509022 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: [pid: 101680|app: 0|req: 21/41] 10.222.0.60 () {60 vars in 1210 bytes} [Wed Dec 15 13:25:08 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:25:08.519462 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi [None req-2e902c9a-1bed-418a-b69e-433e6ce27569 admin admin] Calling method '>' {{(pid=101681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:25:08.525011 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: INFO nova.api.openstack.wsgi [None req-2e902c9a-1bed-418a-b69e-433e6ce27569 admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 15 13:25:08.525568 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi [None req-2e902c9a-1bed-418a-b69e-433e6ce27569 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:25:08.526344 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: INFO nova.api.openstack.requestlog [None req-2e902c9a-1bed-418a-b69e-433e6ce27569 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010571 Dec 15 13:25:08.526941 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: [pid: 101681|app: 0|req: 21/42] 10.222.0.60 () {60 vars in 1190 bytes} [Wed Dec 15 13:25:08 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 13:25:10.101016 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi [None req-6d594ddc-b0a1-4d53-bb2f-4a8b3b4a597c admin admin] Calling method '>' {{(pid=101680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:25:10.102017 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: INFO nova.api.openstack.requestlog [None req-6d594ddc-b0a1-4d53-bb2f-4a8b3b4a597c admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Dec 15 13:25:10.102411 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: [pid: 101680|app: 0|req: 22/43] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Dec 15 13:25:10 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:25:10.290402 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi [None req-8e80c25e-34b5-4e6f-bd78-9786ada035fb admin admin] Calling method '>' {{(pid=101681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:25:10.296483 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: INFO nova.api.openstack.wsgi [None req-8e80c25e-34b5-4e6f-bd78-9786ada035fb admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 15 13:25:10.297026 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi [None req-8e80c25e-34b5-4e6f-bd78-9786ada035fb admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:25:10.297795 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: INFO nova.api.openstack.requestlog [None req-8e80c25e-34b5-4e6f-bd78-9786ada035fb admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.057606 Dec 15 13:25:10.298282 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: [pid: 101681|app: 0|req: 22/44] 10.222.0.60 () {60 vars in 1190 bytes} [Wed Dec 15 13:25:10 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 13:25:10.308067 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi [None req-d7df303d-8976-47d9-a1c2-db55bbefb0c9 admin admin] Calling method '>' {{(pid=101680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:25:10.321918 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: INFO nova.api.openstack.requestlog [None req-d7df303d-8976-47d9-a1c2-db55bbefb0c9 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017317 Dec 15 13:25:10.322384 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: [pid: 101680|app: 0|req: 23/45] 10.222.0.60 () {60 vars in 1210 bytes} [Wed Dec 15 13:25:10 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:25:10.332148 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi [None req-6b99d126-fbbc-43b6-a34a-357f09a0851e admin admin] Calling method '>' {{(pid=101681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:25:10.345284 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: INFO nova.api.openstack.requestlog [None req-6b99d126-fbbc-43b6-a34a-357f09a0851e admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016553 Dec 15 13:25:10.345797 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: [pid: 101681|app: 0|req: 23/46] 10.222.0.60 () {60 vars in 1210 bytes} [Wed Dec 15 13:25:10 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:25:10.355244 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi [None req-48a78cb7-2175-4e35-81d4-08078a59fe78 admin admin] Calling method '>' {{(pid=101680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:25:10.360850 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: INFO nova.api.openstack.wsgi [None req-48a78cb7-2175-4e35-81d4-08078a59fe78 admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 15 13:25:10.361395 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi [None req-48a78cb7-2175-4e35-81d4-08078a59fe78 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:25:10.362163 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: INFO nova.api.openstack.requestlog [None req-48a78cb7-2175-4e35-81d4-08078a59fe78 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010424 Dec 15 13:25:10.362641 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: [pid: 101680|app: 0|req: 24/47] 10.222.0.60 () {60 vars in 1190 bytes} [Wed Dec 15 13:25:10 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 13:25:11.840156 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi [None req-6b99d126-fbbc-43b6-a34a-357f09a0851e admin admin] Calling method '>' {{(pid=101681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:25:11.841154 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: INFO nova.api.openstack.requestlog [None req-6b99d126-fbbc-43b6-a34a-357f09a0851e admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001403 Dec 15 13:25:11.841548 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: [pid: 101681|app: 0|req: 24/48] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Dec 15 13:25:11 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:25:12.038339 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi [None req-792f392e-ca13-473a-876d-aa1f61f7e813 admin admin] Calling method '>' {{(pid=101680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:25:12.043597 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: INFO nova.api.openstack.wsgi [None req-792f392e-ca13-473a-876d-aa1f61f7e813 admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 15 13:25:12.044141 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi [None req-792f392e-ca13-473a-876d-aa1f61f7e813 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:25:12.045432 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: INFO nova.api.openstack.requestlog [None req-792f392e-ca13-473a-876d-aa1f61f7e813 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.062552 Dec 15 13:25:12.045931 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: [pid: 101680|app: 0|req: 25/49] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Dec 15 13:25:11 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 13:25:12.055905 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi [None req-73e6bfa7-da82-4939-9f85-0fe9cd9736f7 admin admin] Calling method '>' {{(pid=101681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:25:12.069636 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: INFO nova.api.openstack.requestlog [None req-73e6bfa7-da82-4939-9f85-0fe9cd9736f7 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017226 Dec 15 13:25:12.070141 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: [pid: 101681|app: 0|req: 25/50] 10.222.0.60 () {60 vars in 1210 bytes} [Wed Dec 15 13:25:12 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:25:12.081097 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi [None req-e98b4f01-f4f3-4aa2-9cd3-60b3e536d09f admin admin] Calling method '>' {{(pid=101680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:25:12.095359 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: INFO nova.api.openstack.requestlog [None req-e98b4f01-f4f3-4aa2-9cd3-60b3e536d09f admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019159 Dec 15 13:25:12.095872 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: [pid: 101680|app: 0|req: 26/51] 10.222.0.60 () {60 vars in 1210 bytes} [Wed Dec 15 13:25:12 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:25:12.105455 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi [None req-62e6e8f0-b00c-4ba6-89fa-0c3a9ae1da03 admin admin] Calling method '>' {{(pid=101681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:25:12.111210 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: INFO nova.api.openstack.wsgi [None req-62e6e8f0-b00c-4ba6-89fa-0c3a9ae1da03 admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 15 13:25:12.111761 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi [None req-62e6e8f0-b00c-4ba6-89fa-0c3a9ae1da03 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:25:12.112528 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: INFO nova.api.openstack.requestlog [None req-62e6e8f0-b00c-4ba6-89fa-0c3a9ae1da03 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010607 Dec 15 13:25:12.113011 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: [pid: 101681|app: 0|req: 26/52] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Dec 15 13:25:12 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 13:25:13.599171 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi [None req-e98b4f01-f4f3-4aa2-9cd3-60b3e536d09f admin admin] Calling method '>' {{(pid=101680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:25:13.600166 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: INFO nova.api.openstack.requestlog [None req-e98b4f01-f4f3-4aa2-9cd3-60b3e536d09f admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Dec 15 13:25:13.600561 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: [pid: 101680|app: 0|req: 27/53] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Dec 15 13:25:13 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:25:13.791095 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi [None req-91ed6766-2e51-4f9e-b578-b3bdc2b46e9e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:25:13.810146 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: INFO nova.api.openstack.requestlog [None req-91ed6766-2e51-4f9e-b578-b3bdc2b46e9e admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.069529 Dec 15 13:25:13.810615 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: [pid: 101681|app: 0|req: 27/54] 10.222.0.60 () {64 vars in 1235 bytes} [Wed Dec 15 13:25:13 2021] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:25:15.303894 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi [None req-e98b4f01-f4f3-4aa2-9cd3-60b3e536d09f admin admin] Calling method '>' {{(pid=101680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:25:15.304879 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: INFO nova.api.openstack.requestlog [None req-e98b4f01-f4f3-4aa2-9cd3-60b3e536d09f admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001392 Dec 15 13:25:15.305264 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: [pid: 101680|app: 0|req: 28/55] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Dec 15 13:25:15 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:25:15.494699 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi [None req-5151ad3c-4877-4218-8177-9ac8aea018bd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:25:15.512455 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: INFO nova.api.openstack.requestlog [None req-5151ad3c-4877-4218-8177-9ac8aea018bd admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068703 Dec 15 13:25:15.512986 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: [pid: 101681|app: 0|req: 28/56] 10.222.0.60 () {64 vars in 1235 bytes} [Wed Dec 15 13:25:15 2021] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:25:16.999554 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi [None req-e98b4f01-f4f3-4aa2-9cd3-60b3e536d09f admin admin] Calling method '>' {{(pid=101680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:25:17.000584 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: INFO nova.api.openstack.requestlog [None req-e98b4f01-f4f3-4aa2-9cd3-60b3e536d09f admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Dec 15 13:25:17.000976 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: [pid: 101680|app: 0|req: 29/57] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Dec 15 13:25:16 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:25:17.191724 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi [None req-33c4d614-7aca-4e9a-a469-90a33c144b1d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:25:17.209371 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: INFO nova.api.openstack.requestlog [None req-33c4d614-7aca-4e9a-a469-90a33c144b1d admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.067995 Dec 15 13:25:17.209826 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: [pid: 101681|app: 0|req: 29/58] 10.222.0.60 () {64 vars in 1235 bytes} [Wed Dec 15 13:25:17 2021] POST /compute/v2.1/flavors => generated 407 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:25:18.709240 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi [None req-e98b4f01-f4f3-4aa2-9cd3-60b3e536d09f admin admin] Calling method '>' {{(pid=101680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:25:18.710229 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: INFO nova.api.openstack.requestlog [None req-e98b4f01-f4f3-4aa2-9cd3-60b3e536d09f admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001399 Dec 15 13:25:18.710618 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: [pid: 101680|app: 0|req: 30/59] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Dec 15 13:25:18 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:25:18.901273 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi [None req-2ebe3929-4ab8-456b-85a5-3aa55319f98f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:25:18.918752 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: INFO nova.api.openstack.requestlog [None req-2ebe3929-4ab8-456b-85a5-3aa55319f98f admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.067676 Dec 15 13:25:18.919237 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: [pid: 101681|app: 0|req: 30/60] 10.222.0.60 () {64 vars in 1235 bytes} [Wed Dec 15 13:25:18 2021] POST /compute/v2.1/flavors => generated 409 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:25:20.406246 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi [None req-e98b4f01-f4f3-4aa2-9cd3-60b3e536d09f admin admin] Calling method '>' {{(pid=101680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:25:20.407262 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: INFO nova.api.openstack.requestlog [None req-e98b4f01-f4f3-4aa2-9cd3-60b3e536d09f admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001386 Dec 15 13:25:20.407648 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: [pid: 101680|app: 0|req: 31/61] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Dec 15 13:25:20 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:25:20.595374 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi [None req-6aee342b-f6f2-4688-966d-77c408931133 admin admin] Calling method '>' {{(pid=101681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:25:20.614421 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: INFO nova.api.openstack.requestlog [None req-6aee342b-f6f2-4688-966d-77c408931133 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.068854 Dec 15 13:25:20.614894 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: [pid: 101681|app: 0|req: 31/62] 10.222.0.60 () {60 vars in 1202 bytes} [Wed Dec 15 13:25:20 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:26:08.046175 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi [None req-e98b4f01-f4f3-4aa2-9cd3-60b3e536d09f admin admin] Calling method '>' {{(pid=101680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:26:08.047226 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: INFO nova.api.openstack.requestlog [None req-e98b4f01-f4f3-4aa2-9cd3-60b3e536d09f admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001396 Dec 15 13:26:08.047614 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: [pid: 101680|app: 0|req: 32/63] 10.222.0.60 () {54 vars in 930 bytes} [Wed Dec 15 13:26:08 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:26:08.104039 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi [None req-815bc30e-e119-4abe-bab4-ee85a9f0d7cc admin admin] Calling method '>' {{(pid=101681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:26:08.123751 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: INFO nova.api.openstack.requestlog [None req-815bc30e-e119-4abe-bab4-ee85a9f0d7cc admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.069657 Dec 15 13:26:08.124272 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: [pid: 101681|app: 0|req: 32/64] 10.222.0.60 () {60 vars in 1291 bytes} [Wed Dec 15 13:26:08 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:26:08.146231 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi [None req-516a6dc0-ec0f-4903-a30a-148525010d76 admin admin] Calling method '>' {{(pid=101680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:26:08.153702 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: INFO nova.api.openstack.requestlog [None req-516a6dc0-ec0f-4903-a30a-148525010d76 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011009 Dec 15 13:26:08.154202 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: [pid: 101680|app: 0|req: 33/65] 10.222.0.60 () {60 vars in 1282 bytes} [Wed Dec 15 13:26:08 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:26:08.165914 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi [None req-d0adb4da-5049-4cdd-8f52-ccb1610bc7fb admin admin] Calling method '>' {{(pid=101681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:26:08.173906 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: INFO nova.api.openstack.requestlog [None req-d0adb4da-5049-4cdd-8f52-ccb1610bc7fb admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011357 Dec 15 13:26:08.174411 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: [pid: 101681|app: 0|req: 33/66] 10.222.0.60 () {60 vars in 1285 bytes} [Wed Dec 15 13:26:08 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:26:08.186243 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi [None req-3acba0db-d984-49b2-b3ac-461c990fb18e admin admin] Calling method '>' {{(pid=101680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:26:08.193524 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: INFO nova.api.openstack.requestlog [None req-3acba0db-d984-49b2-b3ac-461c990fb18e admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011121 Dec 15 13:26:08.194025 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: [pid: 101680|app: 0|req: 34/67] 10.222.0.60 () {60 vars in 1285 bytes} [Wed Dec 15 13:26:08 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:26:08.205134 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi [None req-c764e6fc-1846-443d-841e-c4f7b851b60f admin admin] Calling method '>' {{(pid=101681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:26:08.212298 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: INFO nova.api.openstack.requestlog [None req-c764e6fc-1846-443d-841e-c4f7b851b60f admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010446 Dec 15 13:26:08.212800 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: [pid: 101681|app: 0|req: 34/68] 10.222.0.60 () {60 vars in 1282 bytes} [Wed Dec 15 13:26:08 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:27:31.167707 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi [None req-9381aa20-635f-4537-b085-d3c1281922fa tempest-verify_tempest_config-1748479341 tempest-verify_tempest_config-1748479341-project] Calling method '>' {{(pid=101680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:27:31.170180 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: INFO nova.api.openstack.requestlog [None req-9381aa20-635f-4537-b085-d3c1281922fa tempest-verify_tempest_config-1748479341 tempest-verify_tempest_config-1748479341-project] 10.222.0.60 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.104293 Dec 15 13:27:31.170733 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: [pid: 101680|app: 0|req: 35/69] 10.222.0.60 () {58 vars in 1133 bytes} [Wed Dec 15 13:27:31 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:29:03.082393 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi [None req-c764e6fc-1846-443d-841e-c4f7b851b60f admin admin] Calling method '>' {{(pid=101681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:29:03.083417 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: INFO nova.api.openstack.requestlog [None req-c764e6fc-1846-443d-841e-c4f7b851b60f admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002028 Dec 15 13:29:03.083811 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: [pid: 101681|app: 0|req: 35/70] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Dec 15 13:29:03 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:29:03.334597 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi [None req-6e6db82d-b17c-4090-ade0-213627e13fe9 admin admin] Calling method '>' {{(pid=101680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:29:03.335947 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:29:03.335947 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: warnings.warn(msg) Dec 15 13:29:03.337436 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG oslo_concurrency.lockutils [None req-6e6db82d-b17c-4090-ade0-213627e13fe9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:29:03.337924 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG oslo_concurrency.lockutils [None req-6e6db82d-b17c-4090-ade0-213627e13fe9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:29:03.338668 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG oslo_concurrency.lockutils [None req-6e6db82d-b17c-4090-ade0-213627e13fe9 admin admin] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:29:03.339211 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG oslo_concurrency.lockutils [None req-6e6db82d-b17c-4090-ade0-213627e13fe9 admin admin] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:29:03.372402 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: INFO nova.api.openstack.requestlog [None req-6e6db82d-b17c-4090-ade0-213627e13fe9 admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.147255 Dec 15 13:29:03.372956 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: [pid: 101680|app: 0|req: 36/71] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Dec 15 13:29:03 2021] GET /compute/v2.1/os-services => generated 791 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:29:04.894476 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi [None req-c764e6fc-1846-443d-841e-c4f7b851b60f admin admin] Calling method '>' {{(pid=101681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:29:04.895488 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: INFO nova.api.openstack.requestlog [None req-c764e6fc-1846-443d-841e-c4f7b851b60f admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Dec 15 13:29:04.895878 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: [pid: 101681|app: 0|req: 36/72] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Dec 15 13:29:04 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:29:05.086823 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi [None req-4ae2aa9a-27da-4812-9029-b3bacf847dd1 admin admin] Calling method '>' {{(pid=101680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:29:05.088036 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:29:05.088036 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: warnings.warn(msg) Dec 15 13:29:05.089538 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG oslo_concurrency.lockutils [None req-4ae2aa9a-27da-4812-9029-b3bacf847dd1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:29:05.089978 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG oslo_concurrency.lockutils [None req-4ae2aa9a-27da-4812-9029-b3bacf847dd1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:29:05.090791 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG oslo_concurrency.lockutils [None req-4ae2aa9a-27da-4812-9029-b3bacf847dd1 admin admin] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:29:05.091244 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG oslo_concurrency.lockutils [None req-4ae2aa9a-27da-4812-9029-b3bacf847dd1 admin admin] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:29:05.110027 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: INFO nova.api.openstack.requestlog [None req-4ae2aa9a-27da-4812-9029-b3bacf847dd1 admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.073271 Dec 15 13:29:05.110562 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: [pid: 101680|app: 0|req: 37/73] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Dec 15 13:29:05 2021] GET /compute/v2.1/os-services => generated 791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:29:17.038176 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi [None req-c764e6fc-1846-443d-841e-c4f7b851b60f admin admin] Calling method '>' {{(pid=101681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:29:17.039204 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: INFO nova.api.openstack.requestlog [None req-c764e6fc-1846-443d-841e-c4f7b851b60f admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Dec 15 13:29:17.039608 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: [pid: 101681|app: 0|req: 37/74] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Dec 15 13:29:17 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:29:17.233473 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi [None req-f8a8b13e-f96f-43d4-b665-8cc1abd07b5a admin admin] Calling method '>' {{(pid=101680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:29:17.234660 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:29:17.234660 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: warnings.warn(msg) Dec 15 13:29:17.236196 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG oslo_concurrency.lockutils [None req-f8a8b13e-f96f-43d4-b665-8cc1abd07b5a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:29:17.236635 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG oslo_concurrency.lockutils [None req-f8a8b13e-f96f-43d4-b665-8cc1abd07b5a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:29:17.237432 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG oslo_concurrency.lockutils [None req-f8a8b13e-f96f-43d4-b665-8cc1abd07b5a admin admin] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:29:17.237854 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG oslo_concurrency.lockutils [None req-f8a8b13e-f96f-43d4-b665-8cc1abd07b5a admin admin] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:29:17.261925 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: INFO nova.api.openstack.requestlog [None req-f8a8b13e-f96f-43d4-b665-8cc1abd07b5a admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.078371 Dec 15 13:29:17.262399 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: [pid: 101680|app: 0|req: 38/75] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Dec 15 13:29:17 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:29:18.784545 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: DEBUG nova.api.openstack.wsgi [None req-c764e6fc-1846-443d-841e-c4f7b851b60f admin admin] Calling method '>' {{(pid=101681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:29:18.785551 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: INFO nova.api.openstack.requestlog [None req-c764e6fc-1846-443d-841e-c4f7b851b60f admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001596 Dec 15 13:29:18.786495 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: [pid: 101681|app: 0|req: 38/76] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Dec 15 13:29:18 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:29:18.979458 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG nova.api.openstack.wsgi [None req-46465ce7-f9ee-4b3c-abb4-ec36667391cd admin admin] Calling method '>' {{(pid=101680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:29:18.980617 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:29:18.980617 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: warnings.warn(msg) Dec 15 13:29:18.982110 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG oslo_concurrency.lockutils [None req-46465ce7-f9ee-4b3c-abb4-ec36667391cd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:29:18.982543 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG oslo_concurrency.lockutils [None req-46465ce7-f9ee-4b3c-abb4-ec36667391cd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:29:18.983365 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG oslo_concurrency.lockutils [None req-46465ce7-f9ee-4b3c-abb4-ec36667391cd admin admin] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:29:18.983781 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: DEBUG oslo_concurrency.lockutils [None req-46465ce7-f9ee-4b3c-abb4-ec36667391cd admin admin] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:29:19.004206 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: INFO nova.api.openstack.requestlog [None req-46465ce7-f9ee-4b3c-abb4-ec36667391cd admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.076577 Dec 15 13:29:19.004738 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: [pid: 101680|app: 0|req: 39/77] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Dec 15 13:29:18 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:30:17.596718 dv-cinder-813227-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Dec 15 13:30:17.597273 dv-cinder-813227-4-iscsi devstack@n-api.service[101679]: Wed Dec 15 13:30:17 2021 - graceful shutdown triggered... Dec 15 13:30:17.597748 dv-cinder-813227-4-iscsi devstack@n-api.service[101681]: Gracefully killing worker 2 (pid: 101681)... Dec 15 13:30:17.598099 dv-cinder-813227-4-iscsi devstack@n-api.service[101680]: Gracefully killing worker 1 (pid: 101680)... Dec 15 13:30:18.598431 dv-cinder-813227-4-iscsi devstack@n-api.service[101679]: worker 1 buried after 1 seconds Dec 15 13:30:18.598991 dv-cinder-813227-4-iscsi devstack@n-api.service[101679]: worker 2 buried after 1 seconds Dec 15 13:30:18.598991 dv-cinder-813227-4-iscsi devstack@n-api.service[101679]: goodbye to uWSGI. Dec 15 13:30:18.600031 dv-cinder-813227-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Dec 15 13:30:18.600578 dv-cinder-813227-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Dec 15 13:30:18.603444 dv-cinder-813227-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 15 13:30:18.613596 dv-cinder-813227-4-iscsi devstack@n-api.service[116933]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 15 13:30:18.615613 dv-cinder-813227-4-iscsi devstack@n-api.service[116933]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Dec 15 13:30:18 2021] *** Dec 15 13:30:18.615613 dv-cinder-813227-4-iscsi devstack@n-api.service[116933]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 15 13:30:18.615613 dv-cinder-813227-4-iscsi devstack@n-api.service[116933]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 15 13:30:18.615613 dv-cinder-813227-4-iscsi devstack@n-api.service[116933]: nodename: dv-cinder-813227-4-iscsi Dec 15 13:30:18.615613 dv-cinder-813227-4-iscsi devstack@n-api.service[116933]: machine: x86_64 Dec 15 13:30:18.615613 dv-cinder-813227-4-iscsi devstack@n-api.service[116933]: clock source: unix Dec 15 13:30:18.615613 dv-cinder-813227-4-iscsi devstack@n-api.service[116933]: pcre jit disabled Dec 15 13:30:18.615613 dv-cinder-813227-4-iscsi devstack@n-api.service[116933]: detected number of CPU cores: 4 Dec 15 13:30:18.615613 dv-cinder-813227-4-iscsi devstack@n-api.service[116933]: current working directory: / Dec 15 13:30:18.615613 dv-cinder-813227-4-iscsi devstack@n-api.service[116933]: detected binary path: /usr/bin/uwsgi-core Dec 15 13:30:18.616239 dv-cinder-813227-4-iscsi devstack@n-api.service[116933]: your processes number limit is 47680 Dec 15 13:30:18.616239 dv-cinder-813227-4-iscsi devstack@n-api.service[116933]: your memory page size is 4096 bytes Dec 15 13:30:18.616239 dv-cinder-813227-4-iscsi devstack@n-api.service[116933]: detected max file descriptor number: 2048 Dec 15 13:30:18.616239 dv-cinder-813227-4-iscsi devstack@n-api.service[116933]: lock engine: pthread robust mutexes Dec 15 13:30:18.616239 dv-cinder-813227-4-iscsi devstack@n-api.service[116933]: thunder lock: enabled Dec 15 13:30:18.616239 dv-cinder-813227-4-iscsi devstack@n-api.service[116933]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 15 13:30:18.616239 dv-cinder-813227-4-iscsi devstack@n-api.service[116933]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Dec 15 13:30:18.660434 dv-cinder-813227-4-iscsi devstack@n-api.service[116933]: Python main interpreter initialized at 0x5562c29019c0 Dec 15 13:30:18.660434 dv-cinder-813227-4-iscsi devstack@n-api.service[116933]: python threads support enabled Dec 15 13:30:18.660434 dv-cinder-813227-4-iscsi devstack@n-api.service[116933]: your server socket listen backlog is limited to 100 connections Dec 15 13:30:18.660434 dv-cinder-813227-4-iscsi devstack@n-api.service[116933]: your mercy for graceful operations on workers is 90 seconds Dec 15 13:30:18.660956 dv-cinder-813227-4-iscsi devstack@n-api.service[116933]: mapped 403077 bytes (393 KB) for 2 cores Dec 15 13:30:18.660956 dv-cinder-813227-4-iscsi devstack@n-api.service[116933]: *** Operational MODE: preforking *** Dec 15 13:30:18.661265 dv-cinder-813227-4-iscsi devstack@n-api.service[116933]: *** uWSGI is running in multiple interpreter mode *** Dec 15 13:30:18.661265 dv-cinder-813227-4-iscsi devstack@n-api.service[116933]: spawned uWSGI master process (pid: 116933) Dec 15 13:30:18.661356 dv-cinder-813227-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 15 13:30:18.662482 dv-cinder-813227-4-iscsi devstack@n-api.service[116933]: spawned uWSGI worker 1 (pid: 116941, cores: 1) Dec 15 13:30:18.662832 dv-cinder-813227-4-iscsi devstack@n-api.service[116933]: spawned uWSGI worker 2 (pid: 116942, cores: 1) Dec 15 13:30:18.663020 dv-cinder-813227-4-iscsi devstack@n-api.service[116933]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 15 13:30:20.549482 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 13:30:20.549482 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: from cryptography.utils import int_from_bytes Dec 15 13:30:20.550273 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 13:30:20.550273 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: from cryptography.utils import int_from_bytes Dec 15 13:30:20.586807 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 13:30:20.586807 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: from cryptography.utils import int_from_bytes Dec 15 13:30:20.587482 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 13:30:20.587482 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: from cryptography.utils import int_from_bytes Dec 15 13:30:22.989530 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 15 13:30:22.990124 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 15 13:30:22.990281 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 15 13:30:22.990646 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 15 13:30:22.990931 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 15 13:30:22.991324 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:22.991656 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:22.991983 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:22.992310 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:22.992643 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:22.992960 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:22.993313 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:22.993592 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:22.993919 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:22.994187 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:22.994506 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:22.994912 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813227-4-iscsi {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:22.995728 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:22.996041 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:22.996358 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:22.996682 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:22.996995 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:22.997321 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:22.997636 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:22.998133 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:22.999405 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:22.999405 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:22.999594 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:22.999817 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.001150 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.001150 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.001150 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.001150 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.001682 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.001682 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.002060 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813227-4-iscsi {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.002387 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.002711 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.003073 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.004934 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.004934 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.004934 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.004934 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.004934 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.005351 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.005351 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.005624 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.005948 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.006273 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.006582 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.006921 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.007240 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.007582 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.007876 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.008188 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.008445 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.008758 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.009087 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.009415 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.009744 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.010005 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.010259 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.010609 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.010962 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.011279 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.011596 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.011909 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.012228 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.012543 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.012855 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.013167 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.013482 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.013806 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.014129 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.014456 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.014770 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.015122 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.015523 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.015780 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.016094 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.016437 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.016759 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.017073 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.017395 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.017718 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.018029 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.018339 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.018650 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.018998 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.019339 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.019650 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.019906 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.020214 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.020525 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.020891 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.021151 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.021461 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.021771 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.022081 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.022390 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.022700 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.023223 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.023683 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.023881 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.024157 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.024470 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.024784 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.025095 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.025420 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.025745 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.026059 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.026391 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.026701 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.027039 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.027367 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.027679 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.027989 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.028314 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.028625 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.028932 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.029256 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.029570 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.029881 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.030206 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.030513 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.030825 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.031176 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.031486 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.031797 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.032109 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.032419 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.032730 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.033038 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.033345 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.033653 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.033959 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.034283 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.034608 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.034947 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.035263 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.035573 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.035897 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.036239 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.036574 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.036920 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.037240 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.037578 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.037912 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.038235 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.038551 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.038888 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.039224 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.039542 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.039858 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.040172 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.040495 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.040819 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.041156 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.041478 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.042313 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.042642 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.042981 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.043308 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.043642 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.043968 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.044286 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.044630 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.044974 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.045294 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.045624 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.045940 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.046268 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.046585 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.046929 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.047999 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.047999 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.047999 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.048295 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.048512 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.048836 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.049156 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.049469 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.049780 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.050091 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.050406 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.050714 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.051063 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.051542 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.051858 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.052196 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.052513 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.052830 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.053147 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.053457 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.053776 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.054089 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.054399 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.054727 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.055074 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.055196 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 15 13:30:23.055608 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.055689 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 15 13:30:23.055777 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.055901 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 15 13:30:23.056029 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.056287 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.056544 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 15 13:30:23.056659 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.056810 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 15 13:30:23.056911 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.057205 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.057339 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.058100 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.058213 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.058433 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.058576 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.058751 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.058915 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.059447 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.059633 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.059633 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.059932 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.060086 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.060237 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.060391 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.060536 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.060685 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.060829 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.060979 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.061137 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.061293 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.061457 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.061615 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813227-4-iscsi {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.061760 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.061910 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.062061 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.062219 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.062363 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.062513 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.062657 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.062808 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.063012 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.063198 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.063350 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.063350 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.063646 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.063815 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.063976 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.064120 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.064263 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.064433 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.064591 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.064735 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.065274 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.065436 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.065581 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.065731 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.065876 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.066028 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.066335 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.066496 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.066641 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.066783 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.066958 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.067115 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.067270 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.067432 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.067583 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.067734 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.068126 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.068284 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.068284 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.068575 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813227-4-iscsi {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.068575 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.068871 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.069024 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.069178 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.069322 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.069470 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.069470 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.069782 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.069928 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.070657 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.070819 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.071016 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.071162 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.071372 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.071519 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.071668 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.071813 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.071963 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.072114 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.072279 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.072424 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.072568 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.072721 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.072865 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.073008 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.073163 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.073307 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.073449 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.073598 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.073751 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.073909 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.074070 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.074215 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.074365 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.074517 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.074667 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.074825 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.075152 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.075544 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.075703 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.075850 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.075991 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.076152 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.076458 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.076636 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.076789 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.076933 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.077085 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.077233 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.077386 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.077386 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.077671 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.077821 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.077974 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.078132 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.078287 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.078439 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.078590 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.078747 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.079009 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.079175 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.079320 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.079463 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.079604 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.079747 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.079889 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.080047 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.080199 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.080354 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.080503 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.080647 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.080797 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.080964 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.081108 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.081259 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.081411 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.081555 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.081711 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.081864 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.082016 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.082160 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.082312 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.082312 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.082602 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.082602 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.082894 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.083042 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.083195 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.083195 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.083480 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.083625 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.083768 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.083918 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.084068 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.084230 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.084384 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.084528 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.084678 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.084829 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.084986 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.085296 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.085718 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.085871 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.086023 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.086167 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.086308 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.086603 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.086766 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.086938 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.087084 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.087240 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.087384 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.087541 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.087693 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.087836 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.087986 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.088138 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.088289 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.088446 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.088605 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.088755 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.088904 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.089055 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.089206 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.089359 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.089510 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.089660 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.089803 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.089953 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.090106 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.090258 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.090461 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.090461 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.090773 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.090939 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.091102 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.091256 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.091401 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.091550 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.091704 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.091856 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.092013 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.092172 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.092323 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.092468 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.092626 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.092769 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.092923 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.093066 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.093215 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.093367 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.093518 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.093518 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.093808 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.093951 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.094092 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.094241 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.094395 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.094572 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.094902 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.095056 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.095227 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.095536 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.095927 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.096084 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.096238 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.096390 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.096684 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.096836 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.096979 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.097130 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.097349 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.097506 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.097670 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.097825 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.097969 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.098111 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.098260 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.098260 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.098616 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.098773 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.098981 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.099127 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.099282 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.099442 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.099587 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.099729 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.099886 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.100039 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.100039 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.100326 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.100467 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.100620 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.100764 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.100912 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.101068 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.101222 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.101365 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.101507 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.101648 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.101791 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.101941 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.102084 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.102235 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.102386 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.102529 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.102670 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.102821 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.102988 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.103151 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:30:23.103295 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.103295 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.103578 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.103730 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.103882 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.104033 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.104177 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.104806 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.104959 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.105102 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.105252 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.105548 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.105703 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.106156 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.106318 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.106464 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.106927 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.107106 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.107254 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.107404 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.107556 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.107738 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.108060 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.108227 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.108387 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.108540 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.108684 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.108834 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.108994 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.109153 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.109305 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.109570 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.109738 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.109738 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.110031 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.110031 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.110031 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.110031 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.110031 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.110031 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.110031 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.110031 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.111210 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.111210 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.111210 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.111210 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.111835 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.111986 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.111986 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.111986 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.111986 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.111986 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.111986 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.111986 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.112972 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.113130 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.113289 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.113448 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.113599 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.113746 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.113901 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.114051 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.114210 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.114369 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.114528 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.114678 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.114834 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.115041 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.115041 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.115336 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.115653 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.115815 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.115988 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.116416 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.116580 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.116752 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.117048 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.117203 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.117360 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.117520 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.117685 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.117845 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.118004 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.118153 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.118308 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.118458 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.118623 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.118774 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.118966 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.119128 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.119278 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.119427 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.119590 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.119741 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.120021 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.120672 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.120830 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.120980 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.121143 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.121311 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.121473 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.121632 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.121792 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.121951 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.122102 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.122258 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.122408 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.122564 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.122714 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.122714 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.123151 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.123314 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.123475 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.123645 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.123796 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.123954 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.124104 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.124261 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.124408 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.124556 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.124710 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.124945 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.125098 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.125253 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.125404 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.125552 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.125552 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.126035 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.126211 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.126610 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.126763 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.126968 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.127274 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.127440 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.127592 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.127741 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.127889 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.128038 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.128200 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.128367 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.128516 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.128672 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.128830 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.128982 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.129140 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.129291 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.129439 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.129594 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.129745 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.129903 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.130056 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.130222 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.130381 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.130539 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.130711 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.130897 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.131056 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.131216 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.131367 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.131516 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.131688 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.132428 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.132600 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.132761 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.132925 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.133082 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.133249 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.133417 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.133575 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.133726 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.133881 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.134031 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.134180 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.134344 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.134495 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.134643 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.134790 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.134988 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.135156 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.135322 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.135501 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.135657 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.135974 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.136145 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.136313 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.136732 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.136890 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.137048 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.137354 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.137513 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.137686 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.137686 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.137981 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.138129 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.138286 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.138438 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.138596 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.138747 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.138925 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.139091 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.139242 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.139400 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.139560 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.139723 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.139872 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.140020 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.140020 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.140322 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.140473 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.140623 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.140770 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.140927 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.141086 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.141243 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.141402 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.141573 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.141725 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.141883 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.142040 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.142200 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.142359 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.142509 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.142509 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.142803 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.142987 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.143148 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.143306 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.143457 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.143623 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.143782 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.143947 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.144107 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.144257 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.144413 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.144413 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.144706 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.144872 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.145040 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.145198 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.145357 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.145357 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.145662 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.145829 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.146146 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.146305 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.146455 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.146959 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.147454 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.147616 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.147767 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.147916 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.148064 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.148064 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.148362 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.151190 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.151383 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.151546 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.151711 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.151866 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.152035 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.152189 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.152339 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.152489 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.152647 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.152797 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.152960 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.153126 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.153283 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.153433 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.153583 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.153741 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.153899 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.154050 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.154199 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.154347 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.154504 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.154673 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.154833 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.155021 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.155185 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.155421 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.155574 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.155738 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.155907 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.156066 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.156402 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.156563 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.156738 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.157179 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.157340 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.157639 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.157796 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.157958 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.158115 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.158276 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.158436 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.158593 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.158743 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.158956 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.159125 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.159285 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.159438 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.159595 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.159748 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.159896 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.160132 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.160294 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.160447 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.160596 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.160751 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.160751 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.161052 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.161210 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.161436 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.161598 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.161758 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.161918 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.162087 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.162240 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.162390 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.162390 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.162684 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.162864 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.163033 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.163185 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.163334 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.163490 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.163642 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.163804 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.163954 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.164114 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.164262 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.164409 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.164557 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.164725 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.164884 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.165035 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.165190 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.165340 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.165487 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.165645 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.165811 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.165974 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.166137 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.166313 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.166616 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.167776 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.167949 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.168110 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.168277 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.168437 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.168602 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.168761 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.168912 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.169061 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.169219 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.169391 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.169552 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.169713 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.169865 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.170022 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.170180 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.170331 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.170495 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.170646 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.170794 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.170970 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.171122 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.171288 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.171452 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.171601 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.171757 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.171915 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.172074 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.172235 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.172394 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.172550 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.172700 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.172856 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.173076 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.173238 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.173408 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.173569 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.173721 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.173877 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.173877 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.174180 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.174331 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.174489 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.174653 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.174812 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.175026 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.175026 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.175324 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.175494 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.175654 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.175805 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.175968 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.176130 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.176287 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.176449 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.176762 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.176929 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.177090 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.177243 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.177410 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.177988 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.178156 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.178319 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.178479 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.178639 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.178798 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.179046 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.179209 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.179372 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.179524 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.179681 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.179833 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.179991 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.180160 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.180326 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.180485 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.180638 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.180787 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.180935 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.181083 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.181246 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.181399 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.181547 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.181695 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.181843 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.182006 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.182167 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.182317 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.182529 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.183238 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.183400 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.183567 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.183720 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.183877 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.184035 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.184199 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.184357 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.184515 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.184674 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.184834 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.184984 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.185147 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.185297 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.185445 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.185603 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.185760 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.185924 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.186076 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.186233 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.186233 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.186528 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.186704 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.187045 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.187045 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.187335 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.187484 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.188066 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.188245 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.188413 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.188565 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.188721 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.188883 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.189042 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.189206 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.189369 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.189369 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.189651 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.189810 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.189961 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.190126 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.190287 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.190437 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.190673 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.190673 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.191004 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.191223 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.191376 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.191537 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.191696 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.191847 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.191998 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.192160 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.192311 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.192471 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.192623 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.192780 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.193189 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.193343 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.193492 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.193651 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.193808 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.193959 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.194122 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.194284 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.194435 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.194583 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.194732 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.194932 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.195091 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.195091 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.195384 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.195555 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.195706 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.195868 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.196028 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.196188 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.196352 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.196507 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.196663 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.196846 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.197137 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.197295 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.197506 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.197669 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.197963 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.198432 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.198587 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.198744 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.198940 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.199107 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.199275 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.199440 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.199595 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.199753 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.199903 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.200060 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.200230 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.200230 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.200547 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.200713 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.200877 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.201028 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.201184 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.201335 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.201491 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.201650 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.201810 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.201978 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.203322 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.203515 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.203679 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.203840 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.203840 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.204293 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.204445 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.204602 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.204753 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.204902 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.205065 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.205215 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.205364 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.205521 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.205685 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.205848 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.206000 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.206148 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.206301 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.206556 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.206721 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.206910 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.207086 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.207388 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.207538 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.207687 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.207687 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.208079 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.208481 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.208737 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.208737 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.209042 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.209201 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.209363 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.209514 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.209670 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.209822 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.209978 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.210144 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.210315 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.210474 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.210625 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.210783 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.210992 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.211157 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.211316 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.211518 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.211672 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.211822 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.211969 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.212131 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.212283 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.212450 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.212602 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.212751 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.212901 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.213064 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.213214 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.213370 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.213521 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.213700 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.213864 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.214017 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.214165 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.214320 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.214488 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.214638 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.214794 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.214973 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.215123 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.215272 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.215430 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.216596 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.216814 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.216978 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.217130 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.217682 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.217842 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.217842 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.217842 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.218680 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.218963 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.219134 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.219295 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.219456 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.219607 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.219607 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.219891 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.220039 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.220188 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.220364 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.220516 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.220672 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.220830 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.220982 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.221130 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.221294 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.221452 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.221602 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.221758 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.221915 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.222074 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.222241 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.222404 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.222553 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.222709 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.222907 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.223065 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.223266 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.223430 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.223591 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.223742 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.223890 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.223890 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.224270 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.224270 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.224576 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.224735 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.224894 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.225053 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.225204 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.225354 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.225511 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.225662 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.225811 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.225811 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.226110 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.226267 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.226519 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.226674 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.226839 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.227025 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.227185 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.227335 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.227659 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.227825 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.227985 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.228146 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.228385 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.228788 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.228970 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.229742 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.229920 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.230081 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.230081 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.230367 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.230516 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.230679 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.230840 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.231037 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.231187 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.231335 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.231494 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.231655 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.231817 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.231968 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.231968 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.232249 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.232406 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.232577 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.232729 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.232878 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.232878 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.232878 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.233314 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.233473 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.233639 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.233639 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.233639 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.233639 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.233639 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.233639 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.233639 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.233639 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.234784 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.234784 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.235142 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.235302 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.235452 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.235612 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.235761 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.235909 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.236142 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.236303 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.236461 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.236622 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.236781 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.236949 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.237257 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.237448 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.237766 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.237940 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.238101 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.238268 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.238508 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.238682 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.239085 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.239269 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.239526 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.240255 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.240426 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.240579 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.240729 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.240879 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.241699 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.241882 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.242038 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.242198 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.242352 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.242648 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.242825 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.243016 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.243178 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.243331 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.243481 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.243704 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.243870 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.244035 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.244193 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.244354 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.244519 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.244679 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.244871 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.245646 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.245808 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.245959 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.246109 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.246332 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.246496 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.246659 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.246810 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.246989 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.247155 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.247325 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.247487 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.247640 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.247971 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.248138 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.248299 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.248466 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.248733 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.248908 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.249342 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.249532 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.249798 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.249968 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.250122 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.250273 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.250432 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.250639 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.250804 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.251050 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.251253 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.251408 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.251570 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.251743 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.251904 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.252066 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.252218 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.252405 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.252572 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.252724 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.252885 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.253044 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.253196 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.253346 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.253527 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.253692 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.253855 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.254016 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.254218 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.254377 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.254528 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.254691 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.254873 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.255032 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.255213 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.255408 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.255565 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.255736 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.255889 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.256059 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.256212 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.256362 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.256552 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.256716 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.256877 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.257047 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.257241 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.258214 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.258407 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.258572 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.258752 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.259027 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.259482 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.259661 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.260003 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.260100 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.260239 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.261355 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.261528 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.261683 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.261835 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.261835 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.261835 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.261835 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.261835 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.261835 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.261835 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 15 13:30:23.262916 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.262916 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.262916 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.262916 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.262916 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.262916 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.262916 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.262916 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.263891 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.263891 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.263891 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.263891 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.263891 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.263891 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.263891 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.263891 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.264644 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.264644 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.264644 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.264644 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.264644 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.264644 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.264644 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.264644 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.265451 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.265451 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.265451 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.265451 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.265451 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.265879 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.266058 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.266384 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.266711 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.266918 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_db.sqlalchemy.engines [None req-dcb765e8-56cc-40cc-9d91-0cbeb483f1bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116941) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 13:30:23.278753 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.278753 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.278753 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.278753 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.278753 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.278753 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.278753 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.278753 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.279477 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.279477 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.279477 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.279477 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.279477 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.279477 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.279477 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.279936 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.279936 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.279936 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.279936 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.279936 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.279936 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.279936 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.280798 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.280798 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.281054 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.281383 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.281716 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.282047 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.282393 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.282746 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.283108 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.283443 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.283771 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.284123 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.284700 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.285035 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.285387 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.286183 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.286183 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.286488 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.286742 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.287127 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.287455 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.287776 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.288103 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.288426 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.288751 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.289086 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.289443 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.289793 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.290157 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.290514 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.291106 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.291467 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.291852 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.292698 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.293039 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.293368 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.293688 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.294021 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.294341 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.294659 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.295007 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.295333 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.295652 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.295968 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.296291 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.296612 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.296929 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.297250 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.297630 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.297928 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.298245 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.298560 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.298962 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.299221 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.299536 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.299852 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.300167 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.300486 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.300809 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.301124 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.301442 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.301756 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.302075 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.302391 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.302707 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.303049 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.303385 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.303712 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.304028 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.304353 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.304695 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.305046 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.305369 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.305689 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.306051 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.306376 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.307071 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.307490 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.307818 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.308164 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.308587 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.308825 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.309215 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.309535 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.309912 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.310413 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.310743 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.311207 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.311433 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.311741 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.312062 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.312383 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.312705 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.313027 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.313353 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.313705 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.314036 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.314362 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.314688 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.315039 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.315360 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.315681 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.316004 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.316323 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.316649 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.316989 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.317314 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.317628 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.318321 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.318641 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.318990 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.319321 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.319644 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.319976 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.320308 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.320634 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.320960 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.320960 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.321662 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.321937 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.322480 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.322665 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.322979 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.323450 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.325063 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.325063 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.325063 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.325063 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.325063 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.325628 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.325738 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.326042 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.326367 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.326701 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.327057 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.327386 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.327825 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.328043 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.328363 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.328685 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.329005 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.329328 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.329649 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.329970 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.330305 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.330712 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.330976 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.331313 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.331634 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.332400 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.332400 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.332686 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.332907 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.333232 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.333556 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.333875 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.334195 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.334520 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.334891 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.335200 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.335539 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.335874 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.336150 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.context [None req-dcb765e8-56cc-40cc-9d91-0cbeb483f1bc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b8caafff-75e8-4b27-be31-cfd5761b7f9e(cell1) {{(pid=116941) load_cells /opt/stack/nova/nova/context.py:464}} Dec 15 13:30:23.336298 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.336552 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.336874 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.337227 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.337564 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.337891 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.338207 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.338520 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:30:23.339343 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 15 13:30:23.340994 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-dcb765e8-56cc-40cc-9d91-0cbeb483f1bc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:30:23.342627 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-dcb765e8-56cc-40cc-9d91-0cbeb483f1bc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:30:23.343474 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-dcb765e8-56cc-40cc-9d91-0cbeb483f1bc None None] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:30:23.345410 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-dcb765e8-56cc-40cc-9d91-0cbeb483f1bc None None] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:30:23.358178 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_db.sqlalchemy.engines [None req-dcb765e8-56cc-40cc-9d91-0cbeb483f1bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116941) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 13:30:23.359134 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_db.sqlalchemy.engines [None req-dcb765e8-56cc-40cc-9d91-0cbeb483f1bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116941) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 13:30:23.362325 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_db.sqlalchemy.engines [None req-6ea586f7-9419-48bc-bee0-007de1a5de21 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116942) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 13:30:23.429085 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.context [None req-6ea586f7-9419-48bc-bee0-007de1a5de21 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b8caafff-75e8-4b27-be31-cfd5761b7f9e(cell1) {{(pid=116942) load_cells /opt/stack/nova/nova/context.py:464}} Dec 15 13:30:23.433389 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6ea586f7-9419-48bc-bee0-007de1a5de21 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:30:23.435008 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6ea586f7-9419-48bc-bee0-007de1a5de21 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:30:23.435854 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6ea586f7-9419-48bc-bee0-007de1a5de21 None None] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:30:23.437799 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6ea586f7-9419-48bc-bee0-007de1a5de21 None None] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:30:23.450008 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_db.sqlalchemy.engines [None req-6ea586f7-9419-48bc-bee0-007de1a5de21 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116942) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 13:30:23.451082 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_db.sqlalchemy.engines [None req-6ea586f7-9419-48bc-bee0-007de1a5de21 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116942) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 13:30:23.518964 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_db.sqlalchemy.engines [None req-dcb765e8-56cc-40cc-9d91-0cbeb483f1bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116941) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 13:30:23.608507 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_db.sqlalchemy.engines [None req-6ea586f7-9419-48bc-bee0-007de1a5de21 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116942) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 13:30:23.848506 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: WARNING keystonemiddleware.auth_token [None req-dcb765e8-56cc-40cc-9d91-0cbeb483f1bc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 13:30:23.855338 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: WARNING keystonemiddleware.auth_token [None req-dcb765e8-56cc-40cc-9d91-0cbeb483f1bc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 13:30:23.934492 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: WARNING keystonemiddleware.auth_token [None req-6ea586f7-9419-48bc-bee0-007de1a5de21 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 13:30:23.941605 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: WARNING keystonemiddleware.auth_token [None req-6ea586f7-9419-48bc-bee0-007de1a5de21 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 13:30:24.199858 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: WARNING keystonemiddleware.auth_token [None req-dcb765e8-56cc-40cc-9d91-0cbeb483f1bc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 13:30:24.205039 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: WARNING keystonemiddleware.auth_token [None req-dcb765e8-56cc-40cc-9d91-0cbeb483f1bc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 13:30:24.210308 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5562c29019c0 pid: 116941 (default app) Dec 15 13:30:24.285685 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: WARNING keystonemiddleware.auth_token [None req-6ea586f7-9419-48bc-bee0-007de1a5de21 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 13:30:24.290958 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: WARNING keystonemiddleware.auth_token [None req-6ea586f7-9419-48bc-bee0-007de1a5de21 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 13:30:24.296417 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5562c29019c0 pid: 116942 (default app) Dec 15 13:30:58.683199 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-25c1dda5-cb65-47ee-83cd-4a3d59f80554 tempest-VolumesNegativeTest-940412398 tempest-VolumesNegativeTest-940412398-project] Action: 'create', calling method: .version_select at 0x7ff5153f8e50>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-511237223", "metadata": {"Type": "work"}}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:30:58.694963 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-25c1dda5-cb65-47ee-83cd-4a3d59f80554 tempest-VolumesNegativeTest-940412398 tempest-VolumesNegativeTest-940412398-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:30:58.695965 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-25c1dda5-cb65-47ee-83cd-4a3d59f80554 tempest-VolumesNegativeTest-940412398 tempest-VolumesNegativeTest-940412398-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.298674 Dec 15 13:30:58.703521 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 1/1] 10.222.0.60 () {60 vars in 1155 bytes} [Wed Dec 15 13:30:57 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 1307 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 15 13:30:58.730652 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-016ea2db-56e7-4d34-910a-1282679cafcd tempest-VolumesSnapshotsTestJSON-445504839 tempest-VolumesSnapshotsTestJSON-445504839-project] Action: 'create', calling method: .version_select at 0x7ff5153e8ee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-264007434"}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:30:58.790067 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-b261b7d6-5ec4-4323-84ca-c38ca61b8ef6 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1703788798", "imageRef": "cfccedbb-7169-47ec-9bae-d4829cba54e1", "flavorRef": "452", "networks": [{"uuid": "12997ed3-8144-436a-8d20-22135e6511e5"}]}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:30:59.218363 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.network.neutron [None req-b261b7d6-5ec4-4323-84ca-c38ca61b8ef6 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] validate_networks() for [('12997ed3-8144-436a-8d20-22135e6511e5', None, None, None, None, None)] {{(pid=116941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:30:59.626129 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-016ea2db-56e7-4d34-910a-1282679cafcd tempest-VolumesSnapshotsTestJSON-445504839 tempest-VolumesSnapshotsTestJSON-445504839-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.384971 Dec 15 13:30:59.626782 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 1/2] 10.222.0.60 () {60 vars in 1154 bytes} [Wed Dec 15 13:30:58 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 1387 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Dec 15 13:30:59.632037 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-a5c7064e-a4cf-4801-b737-85a2c2082c86 tempest-VolumesNegativeTest-940412398 tempest-VolumesNegativeTest-940412398-project] Action: 'create', calling method: .version_select at 0x7ff515394a60>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1158465849", "metadata": {"Type": "work"}}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:30:59.635476 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-a5c7064e-a4cf-4801-b737-85a2c2082c86 tempest-VolumesNegativeTest-940412398 tempest-VolumesNegativeTest-940412398-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:30:59.636349 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-a5c7064e-a4cf-4801-b737-85a2c2082c86 tempest-VolumesNegativeTest-940412398 tempest-VolumesNegativeTest-940412398-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008299 Dec 15 13:30:59.636900 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 2/3] 10.222.0.60 () {60 vars in 1155 bytes} [Wed Dec 15 13:30:59 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 15 13:30:59.726336 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-cb7f029d-104a-4a8a-bbb2-a46591834229 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-302667135", "imageRef": "cfccedbb-7169-47ec-9bae-d4829cba54e1", "flavorRef": "452", "networks": [{"uuid": "74e83cc2-a971-4afa-a119-d0be3ac3d84d"}]}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:30:59.847971 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.network.neutron [None req-cb7f029d-104a-4a8a-bbb2-a46591834229 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] validate_networks() for [('74e83cc2-a971-4afa-a119-d0be3ac3d84d', None, None, None, None, None)] {{(pid=116942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:31:00.665236 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-b261b7d6-5ec4-4323-84ca-c38ca61b8ef6 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Flavor limits 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:31:00.667262 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-b261b7d6-5ec4-4323-84ca-c38ca61b8ef6 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Image limits 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:31:00.667789 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-b261b7d6-5ec4-4323-84ca-c38ca61b8ef6 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Flavor pref 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:31:00.668210 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-b261b7d6-5ec4-4323-84ca-c38ca61b8ef6 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Image pref 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:31:00.668652 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-b261b7d6-5ec4-4323-84ca-c38ca61b8ef6 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:31:00.693854 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b261b7d6-5ec4-4323-84ca-c38ca61b8ef6 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:00.696164 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b261b7d6-5ec4-4323-84ca-c38ca61b8ef6 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:00.698486 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b261b7d6-5ec4-4323-84ca-c38ca61b8ef6 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:00.699730 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b261b7d6-5ec4-4323-84ca-c38ca61b8ef6 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:00.766611 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-b261b7d6-5ec4-4323-84ca-c38ca61b8ef6 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Getting quotas for project 18c80dfcc63a49f7b54f89f08cd8842f. Resources: {'cores', 'instances', 'ram'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:31:00.778520 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-b261b7d6-5ec4-4323-84ca-c38ca61b8ef6 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Getting quotas for user df94523ab7c545f2a17a2cafe936d2ed and project 18c80dfcc63a49f7b54f89f08cd8842f. Resources: {'cores', 'instances', 'ram'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:31:00.797936 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-b261b7d6-5ec4-4323-84ca-c38ca61b8ef6 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Going to run 1 instances... {{(pid=116941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:31:00.807155 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-b261b7d6-5ec4-4323-84ca-c38ca61b8ef6 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 10dd91a3-b40e-4ac3-ac2c-63624e87cf93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cfccedbb-7169-47ec-9bae-d4829cba54e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:31:00.949568 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-b261b7d6-5ec4-4323-84ca-c38ca61b8ef6 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.243691 Dec 15 13:31:00.957330 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 2/4] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Dec 15 13:30:58 2021] POST /compute/v2.1/servers => generated 380 bytes in 2248 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 13:31:00.963625 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-9584bb32-37aa-437f-91ee-d0059c30a453 tempest-VolumesSnapshotsTestJSON-445504839 tempest-VolumesSnapshotsTestJSON-445504839-project] Calling method '.version_select at 0x7ff5149f7790>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:01.084974 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-9584bb32-37aa-437f-91ee-d0059c30a453 tempest-VolumesSnapshotsTestJSON-445504839 tempest-VolumesSnapshotsTestJSON-445504839-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/4d36a5a9-fc2f-4a61-bc73-91e81f0f1149" status: 200 len: 345 microversion: 2.1 time: 0.130928 Dec 15 13:31:01.086038 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 3/5] 10.222.0.60 () {58 vars in 1244 bytes} [Wed Dec 15 13:31:00 2021] GET /compute/v2.1/os-volumes/4d36a5a9-fc2f-4a61-bc73-91e81f0f1149 => generated 345 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:31:01.091184 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-92932de6-b79e-4549-86db-2cbbfcb2d9c0 tempest-VolumesNegativeTest-940412398 tempest-VolumesNegativeTest-940412398-project] Action: 'create', calling method: .version_select at 0x7ff5149f7c10>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-259239027", "metadata": {"Type": "work"}}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:31:01.100020 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-92932de6-b79e-4549-86db-2cbbfcb2d9c0 tempest-VolumesNegativeTest-940412398 tempest-VolumesNegativeTest-940412398-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:31:01.101671 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-92932de6-b79e-4549-86db-2cbbfcb2d9c0 tempest-VolumesNegativeTest-940412398 tempest-VolumesNegativeTest-940412398-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.014331 Dec 15 13:31:01.106271 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 4/6] 10.222.0.60 () {60 vars in 1155 bytes} [Wed Dec 15 13:31:01 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 15 13:31:01.107116 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-aadb59ed-9293-4219-9424-ad68a11195f2 tempest-VolumesTestJSON-1526434270 tempest-VolumesTestJSON-1526434270-project] Calling method '.version_select at 0x7ff51416fc10>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:01.176676 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-aadb59ed-9293-4219-9424-ad68a11195f2 tempest-VolumesTestJSON-1526434270 tempest-VolumesTestJSON-1526434270-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/3ad2335d-d8d1-4fc1-a8cb-5d6115e6239f" status: 200 len: 351 microversion: 2.1 time: 0.073044 Dec 15 13:31:01.177362 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 5/7] 10.222.0.60 () {58 vars in 1244 bytes} [Wed Dec 15 13:31:01 2021] GET /compute/v2.1/os-volumes/3ad2335d-d8d1-4fc1-a8cb-5d6115e6239f => generated 351 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:31:01.181756 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-6d83da78-9a29-4835-959f-70a2aa0b4ab4 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:01.182489 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-6d83da78-9a29-4835-959f-70a2aa0b4ab4 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 10dd91a3-b40e-4ac3-ac2c-63624e87cf93] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:01.265367 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-cb7f029d-104a-4a8a-bbb2-a46591834229 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Flavor limits 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:31:01.266067 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-cb7f029d-104a-4a8a-bbb2-a46591834229 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Image limits 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:31:01.266934 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-cb7f029d-104a-4a8a-bbb2-a46591834229 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Flavor pref 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:31:01.267671 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-cb7f029d-104a-4a8a-bbb2-a46591834229 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Image pref 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:31:01.268393 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-cb7f029d-104a-4a8a-bbb2-a46591834229 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:31:01.308035 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-cb7f029d-104a-4a8a-bbb2-a46591834229 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:01.309280 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-cb7f029d-104a-4a8a-bbb2-a46591834229 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:01.312362 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-cb7f029d-104a-4a8a-bbb2-a46591834229 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:01.316676 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-cb7f029d-104a-4a8a-bbb2-a46591834229 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:01.412168 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-cb7f029d-104a-4a8a-bbb2-a46591834229 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Getting quotas for project c6099655f06b473db6eb84adfee54156. Resources: {'cores', 'instances', 'ram'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:31:01.429058 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-cb7f029d-104a-4a8a-bbb2-a46591834229 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Getting quotas for user 07defc49f2774d9e9c7001504aa647ef and project c6099655f06b473db6eb84adfee54156. Resources: {'cores', 'instances', 'ram'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:31:01.452523 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-6d83da78-9a29-4835-959f-70a2aa0b4ab4 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:01.474354 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-cb7f029d-104a-4a8a-bbb2-a46591834229 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Going to run 1 instances... {{(pid=116942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:31:01.479494 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-6d83da78-9a29-4835-959f-70a2aa0b4ab4 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93" status: 200 len: 1218 microversion: 2.1 time: 0.300755 Dec 15 13:31:01.479955 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-cb7f029d-104a-4a8a-bbb2-a46591834229 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] [instance: c3130b20-b0cc-484a-b6b4-b4719540a6a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cfccedbb-7169-47ec-9bae-d4829cba54e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:31:01.498391 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 6/8] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:01 2021] GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93 => generated 1218 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:01.503098 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-e2f57fb6-ed64-4f79-8fb5-464b2c3a2bad tempest-VolumesSnapshotsTestJSON-445504839 tempest-VolumesSnapshotsTestJSON-445504839-project] Action: 'create', calling method: .version_select at 0x7ff51418d9d0>, body: {"snapshot": {"volume_id": "4d36a5a9-fc2f-4a61-bc73-91e81f0f1149", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1720418245"}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:31:01.695792 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-cb7f029d-104a-4a8a-bbb2-a46591834229 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.056141 Dec 15 13:31:01.696578 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 3/9] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Dec 15 13:30:59 2021] POST /compute/v2.1/servers => generated 380 bytes in 2059 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 13:31:01.703002 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-e809ffa2-4c04-48db-994c-b41388fe1415 tempest-VolumesNegativeTest-940412398 tempest-VolumesNegativeTest-940412398-project] Calling method '.version_select at 0x7ff514964430>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:01.845796 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.wsgi [None req-e809ffa2-4c04-48db-994c-b41388fe1415 tempest-VolumesNegativeTest-940412398 tempest-VolumesNegativeTest-940412398-project] HTTP exception thrown: Volume tempest-invalid-591182442 could not be found. Dec 15 13:31:01.846885 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-e809ffa2-4c04-48db-994c-b41388fe1415 tempest-VolumesNegativeTest-940412398 tempest-VolumesNegativeTest-940412398-project] Returning 404 to user: Volume tempest-invalid-591182442 could not be found. {{(pid=116942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:31:01.848840 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-e809ffa2-4c04-48db-994c-b41388fe1415 tempest-VolumesNegativeTest-940412398 tempest-VolumesNegativeTest-940412398-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/tempest-invalid-591182442" status: 404 len: 98 microversion: 2.1 time: 0.150802 Dec 15 13:31:01.849585 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 4/10] 10.222.0.60 () {58 vars in 1214 bytes} [Wed Dec 15 13:31:01 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-591182442 => generated 98 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 15 13:31:01.857321 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-45390f8f-4828-4385-87da-b0f07b109078 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:01.863589 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-45390f8f-4828-4385-87da-b0f07b109078 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] [instance: c3130b20-b0cc-484a-b6b4-b4719540a6a2] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:01.973256 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-e2f57fb6-ed64-4f79-8fb5-464b2c3a2bad tempest-VolumesSnapshotsTestJSON-445504839 tempest-VolumesSnapshotsTestJSON-445504839-project] 10.222.0.60 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.473658 Dec 15 13:31:01.974300 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 7/11] 10.222.0.60 () {60 vars in 1161 bytes} [Wed Dec 15 13:31:01 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:31:01.983082 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-13a5b49f-3a97-4552-bedb-c0a857f581df tempest-VolumesNegativeTest-940412398 tempest-VolumesNegativeTest-940412398-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005386 Dec 15 13:31:01.987955 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 8/12] 10.222.0.60 () {58 vars in 1139 bytes} [Wed Dec 15 13:31:01 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 15 13:31:02.001111 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-b864e7a8-9657-472d-a14b-0bc513b60e34 tempest-VolumesSnapshotsTestJSON-445504839 tempest-VolumesSnapshotsTestJSON-445504839-project] Calling method '.version_select at 0x7ff51417a5e0>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:02.149886 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-b864e7a8-9657-472d-a14b-0bc513b60e34 tempest-VolumesSnapshotsTestJSON-445504839 tempest-VolumesSnapshotsTestJSON-445504839-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/20b42ab9-c28e-4a78-bed7-4878dbca1b92" status: 200 len: 287 microversion: 2.1 time: 0.160487 Dec 15 13:31:02.151076 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 9/13] 10.222.0.60 () {58 vars in 1250 bytes} [Wed Dec 15 13:31:01 2021] GET /compute/v2.1/os-snapshots/20b42ab9-c28e-4a78-bed7-4878dbca1b92 => generated 287 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:31:02.157338 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-62f1a821-2d4f-43d0-9a5e-15aa44a0980e tempest-VolumesNegativeTest-940412398 tempest-VolumesNegativeTest-940412398-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004873 Dec 15 13:31:02.158107 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 10/14] 10.222.0.60 () {58 vars in 1136 bytes} [Wed Dec 15 13:31:02 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 15 13:31:02.203280 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-4c6b628c-ed09-403c-ae15-4acf74a4c811 tempest-VolumesSnapshotsTestJSON-445504839 tempest-VolumesSnapshotsTestJSON-445504839-project] Calling method '.version_select at 0x7ff51417af70>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:02.213658 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-45390f8f-4828-4385-87da-b0f07b109078 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07defc49f2774d9e9c7001504aa647ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6099655f06b473db6eb84adfee54156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:02.261650 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-45390f8f-4828-4385-87da-b0f07b109078 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] 10.222.0.60 "GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2" status: 200 len: 1214 microversion: 2.1 time: 0.410611 Dec 15 13:31:02.263781 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 5/15] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:01 2021] GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2 => generated 1214 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:02.276799 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-fe14883c-6ead-40b8-ba0e-cf9c75dc3a63 tempest-VolumesNegativeTest-940412398 tempest-VolumesNegativeTest-940412398-project] Calling method '.version_select at 0x7ff51497fca0>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:02.311480 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-4c6b628c-ed09-403c-ae15-4acf74a4c811 tempest-VolumesSnapshotsTestJSON-445504839 tempest-VolumesSnapshotsTestJSON-445504839-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.152003 Dec 15 13:31:02.311901 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 11/16] 10.222.0.60 () {58 vars in 1139 bytes} [Wed Dec 15 13:31:02 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:31:02.323553 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-303f9301-6451-405a-9ea9-acb771ea3250 tempest-VolumesSnapshotsTestJSON-445504839 tempest-VolumesSnapshotsTestJSON-445504839-project] Calling method '.version_select at 0x7ff51416f790>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:02.363544 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.wsgi [None req-fe14883c-6ead-40b8-ba0e-cf9c75dc3a63 tempest-VolumesNegativeTest-940412398 tempest-VolumesNegativeTest-940412398-project] HTTP exception thrown: Volume a75a0e4c-7a77-4a45-9b1a-a4fbe1a4d5d1 could not be found. Dec 15 13:31:02.365713 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-fe14883c-6ead-40b8-ba0e-cf9c75dc3a63 tempest-VolumesNegativeTest-940412398 tempest-VolumesNegativeTest-940412398-project] Returning 404 to user: Volume a75a0e4c-7a77-4a45-9b1a-a4fbe1a4d5d1 could not be found. {{(pid=116942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:31:02.366336 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-fe14883c-6ead-40b8-ba0e-cf9c75dc3a63 tempest-VolumesNegativeTest-940412398 tempest-VolumesNegativeTest-940412398-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/a75a0e4c-7a77-4a45-9b1a-a4fbe1a4d5d1" status: 404 len: 109 microversion: 2.1 time: 0.100168 Dec 15 13:31:02.366947 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 6/17] 10.222.0.60 () {58 vars in 1247 bytes} [Wed Dec 15 13:31:02 2021] DELETE /compute/v2.1/os-volumes/a75a0e4c-7a77-4a45-9b1a-a4fbe1a4d5d1 => generated 109 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:31:02.377878 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-d7e5c44f-9273-4bf9-b91b-53484f51e489 tempest-VolumesNegativeTest-940412398 tempest-VolumesNegativeTest-940412398-project] Calling method '.version_select at 0x7ff514127310>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:02.421348 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-303f9301-6451-405a-9ea9-acb771ea3250 tempest-VolumesSnapshotsTestJSON-445504839 tempest-VolumesSnapshotsTestJSON-445504839-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/20b42ab9-c28e-4a78-bed7-4878dbca1b92" status: 200 len: 287 microversion: 2.1 time: 0.102953 Dec 15 13:31:02.422019 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 12/18] 10.222.0.60 () {58 vars in 1250 bytes} [Wed Dec 15 13:31:02 2021] GET /compute/v2.1/os-snapshots/20b42ab9-c28e-4a78-bed7-4878dbca1b92 => generated 287 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:31:02.426838 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.wsgi [None req-d7e5c44f-9273-4bf9-b91b-53484f51e489 tempest-VolumesNegativeTest-940412398 tempest-VolumesNegativeTest-940412398-project] HTTP exception thrown: Volume 8120bffd-63b3-4326-b957-d4504e72f10b could not be found. Dec 15 13:31:02.428052 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-d7e5c44f-9273-4bf9-b91b-53484f51e489 tempest-VolumesNegativeTest-940412398 tempest-VolumesNegativeTest-940412398-project] Returning 404 to user: Volume 8120bffd-63b3-4326-b957-d4504e72f10b could not be found. {{(pid=116942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:31:02.429370 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-d7e5c44f-9273-4bf9-b91b-53484f51e489 tempest-VolumesNegativeTest-940412398 tempest-VolumesNegativeTest-940412398-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/8120bffd-63b3-4326-b957-d4504e72f10b" status: 404 len: 109 microversion: 2.1 time: 0.055874 Dec 15 13:31:02.442740 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 7/19] 10.222.0.60 () {58 vars in 1244 bytes} [Wed Dec 15 13:31:02 2021] GET /compute/v2.1/os-volumes/8120bffd-63b3-4326-b957-d4504e72f10b => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:31:02.505672 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-c54ebbe6-6164-42e3-82cf-fa6c1c6e1318 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:02.506718 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-c54ebbe6-6164-42e3-82cf-fa6c1c6e1318 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 10dd91a3-b40e-4ac3-ac2c-63624e87cf93] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:02.688547 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-c54ebbe6-6164-42e3-82cf-fa6c1c6e1318 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:02.703610 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-c54ebbe6-6164-42e3-82cf-fa6c1c6e1318 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93" status: 200 len: 1218 microversion: 2.1 time: 0.200741 Dec 15 13:31:02.704324 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 13/20] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:02 2021] GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93 => generated 1218 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:02.881440 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-1c1de39c-64e5-44ff-9d3b-31162f625c71 tempest-VolumesTestJSON-1526434270 tempest-VolumesTestJSON-1526434270-project] Calling method '.version_select at 0x7ff5149648b0>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:02.989889 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-1c1de39c-64e5-44ff-9d3b-31162f625c71 tempest-VolumesTestJSON-1526434270 tempest-VolumesTestJSON-1526434270-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/57ba2297-d189-452a-ad67-27aa40d6e531" status: 200 len: 350 microversion: 2.1 time: 0.112733 Dec 15 13:31:02.990787 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 8/21] 10.222.0.60 () {58 vars in 1244 bytes} [Wed Dec 15 13:31:02 2021] GET /compute/v2.1/os-volumes/57ba2297-d189-452a-ad67-27aa40d6e531 => generated 350 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:31:03.280253 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-d760be1c-a763-4900-9b05-d14c165c3f3f tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:03.280875 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-d760be1c-a763-4900-9b05-d14c165c3f3f tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] [instance: c3130b20-b0cc-484a-b6b4-b4719540a6a2] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:03.371876 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-d760be1c-a763-4900-9b05-d14c165c3f3f tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07defc49f2774d9e9c7001504aa647ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6099655f06b473db6eb84adfee54156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:03.386426 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-d760be1c-a763-4900-9b05-d14c165c3f3f tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] 10.222.0.60 "GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2" status: 200 len: 1214 microversion: 2.1 time: 0.110236 Dec 15 13:31:03.388894 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 14/22] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:03 2021] GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2 => generated 1214 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:03.434293 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-7906bbc9-cf67-4040-ac15-fd239cfef80e tempest-VolumesSnapshotsTestJSON-445504839 tempest-VolumesSnapshotsTestJSON-445504839-project] Calling method '.version_select at 0x7ff514127820>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:03.522430 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-7906bbc9-cf67-4040-ac15-fd239cfef80e tempest-VolumesSnapshotsTestJSON-445504839 tempest-VolumesSnapshotsTestJSON-445504839-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/20b42ab9-c28e-4a78-bed7-4878dbca1b92" status: 200 len: 287 microversion: 2.1 time: 0.092549 Dec 15 13:31:03.523448 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 9/23] 10.222.0.60 () {58 vars in 1250 bytes} [Wed Dec 15 13:31:03 2021] GET /compute/v2.1/os-snapshots/20b42ab9-c28e-4a78-bed7-4878dbca1b92 => generated 287 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:31:03.720999 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-b12aa5c1-4385-4807-9d34-16733483f54f tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:03.721855 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-b12aa5c1-4385-4807-9d34-16733483f54f tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 10dd91a3-b40e-4ac3-ac2c-63624e87cf93] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:03.737566 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b12aa5c1-4385-4807-9d34-16733483f54f tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:03.739593 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b12aa5c1-4385-4807-9d34-16733483f54f tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:03.740571 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b12aa5c1-4385-4807-9d34-16733483f54f tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:03.741271 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b12aa5c1-4385-4807-9d34-16733483f54f tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:03.946281 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-b12aa5c1-4385-4807-9d34-16733483f54f tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:03.973489 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-b12aa5c1-4385-4807-9d34-16733483f54f tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93" status: 200 len: 1222 microversion: 2.1 time: 0.256637 Dec 15 13:31:03.974283 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 15/24] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:03 2021] GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93 => generated 1222 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:04.408158 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ccd66c89-759b-43ce-a33d-a252c2bd4c78 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:04.411854 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ccd66c89-759b-43ce-a33d-a252c2bd4c78 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] [instance: c3130b20-b0cc-484a-b6b4-b4719540a6a2] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:04.442710 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ccd66c89-759b-43ce-a33d-a252c2bd4c78 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:04.448916 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ccd66c89-759b-43ce-a33d-a252c2bd4c78 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:04.451990 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ccd66c89-759b-43ce-a33d-a252c2bd4c78 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:04.452462 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ccd66c89-759b-43ce-a33d-a252c2bd4c78 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:04.537938 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-c1203558-a2f4-44e4-9ba5-0ac511ede15c tempest-VolumesSnapshotsTestJSON-445504839 tempest-VolumesSnapshotsTestJSON-445504839-project] Calling method '.version_select at 0x7ff51412ad30>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:04.617230 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-c1203558-a2f4-44e4-9ba5-0ac511ede15c tempest-VolumesSnapshotsTestJSON-445504839 tempest-VolumesSnapshotsTestJSON-445504839-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/20b42ab9-c28e-4a78-bed7-4878dbca1b92" status: 200 len: 287 microversion: 2.1 time: 0.085709 Dec 15 13:31:04.617862 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 16/25] 10.222.0.60 () {58 vars in 1250 bytes} [Wed Dec 15 13:31:04 2021] GET /compute/v2.1/os-snapshots/20b42ab9-c28e-4a78-bed7-4878dbca1b92 => generated 287 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:31:04.991770 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-08dbc298-334a-4a5c-8d7f-53966eca3791 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:04.992460 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-08dbc298-334a-4a5c-8d7f-53966eca3791 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 10dd91a3-b40e-4ac3-ac2c-63624e87cf93] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:05.006686 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-08dbc298-334a-4a5c-8d7f-53966eca3791 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:05.007184 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-08dbc298-334a-4a5c-8d7f-53966eca3791 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:05.008169 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-08dbc298-334a-4a5c-8d7f-53966eca3791 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:05.008765 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-08dbc298-334a-4a5c-8d7f-53966eca3791 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:05.170948 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-ccd66c89-759b-43ce-a33d-a252c2bd4c78 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07defc49f2774d9e9c7001504aa647ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6099655f06b473db6eb84adfee54156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:05.183627 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-08dbc298-334a-4a5c-8d7f-53966eca3791 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:05.183799 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ccd66c89-759b-43ce-a33d-a252c2bd4c78 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] 10.222.0.60 "GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2" status: 200 len: 1218 microversion: 2.1 time: 0.782144 Dec 15 13:31:05.184245 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 10/26] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:04 2021] GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2 => generated 1218 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:05.193496 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-08dbc298-334a-4a5c-8d7f-53966eca3791 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93" status: 200 len: 1222 microversion: 2.1 time: 0.205755 Dec 15 13:31:05.203125 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 17/27] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:04 2021] GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93 => generated 1222 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:05.629441 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-900273a1-d51f-4216-951d-65fe84f14128 tempest-VolumesSnapshotsTestJSON-445504839 tempest-VolumesSnapshotsTestJSON-445504839-project] Calling method '.version_select at 0x7ff5140a2b80>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:05.702339 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-900273a1-d51f-4216-951d-65fe84f14128 tempest-VolumesSnapshotsTestJSON-445504839 tempest-VolumesSnapshotsTestJSON-445504839-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/20b42ab9-c28e-4a78-bed7-4878dbca1b92" status: 200 len: 287 microversion: 2.1 time: 0.073816 Dec 15 13:31:05.702339 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 11/28] 10.222.0.60 () {58 vars in 1250 bytes} [Wed Dec 15 13:31:05 2021] GET /compute/v2.1/os-snapshots/20b42ab9-c28e-4a78-bed7-4878dbca1b92 => generated 287 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:31:06.203049 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-83a328f0-ebdc-442e-b9f9-88795358c6b6 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:06.204527 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-83a328f0-ebdc-442e-b9f9-88795358c6b6 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] [instance: c3130b20-b0cc-484a-b6b4-b4719540a6a2] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:06.211260 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-83a328f0-ebdc-442e-b9f9-88795358c6b6 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:06.211421 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-a63d5423-e4eb-4234-bfad-560e966de44e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:06.211715 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-83a328f0-ebdc-442e-b9f9-88795358c6b6 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:06.212057 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-a63d5423-e4eb-4234-bfad-560e966de44e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 10dd91a3-b40e-4ac3-ac2c-63624e87cf93] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:06.212515 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-83a328f0-ebdc-442e-b9f9-88795358c6b6 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:06.212950 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-83a328f0-ebdc-442e-b9f9-88795358c6b6 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:06.221656 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a63d5423-e4eb-4234-bfad-560e966de44e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:06.230831 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a63d5423-e4eb-4234-bfad-560e966de44e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:06.231720 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a63d5423-e4eb-4234-bfad-560e966de44e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:06.232166 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a63d5423-e4eb-4234-bfad-560e966de44e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:06.385392 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-83a328f0-ebdc-442e-b9f9-88795358c6b6 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07defc49f2774d9e9c7001504aa647ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6099655f06b473db6eb84adfee54156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:06.393828 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-83a328f0-ebdc-442e-b9f9-88795358c6b6 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] 10.222.0.60 "GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2" status: 200 len: 1218 microversion: 2.1 time: 0.197600 Dec 15 13:31:06.401893 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 18/29] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:06 2021] GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2 => generated 1218 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:06.504391 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-a63d5423-e4eb-4234-bfad-560e966de44e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:06.513117 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-a63d5423-e4eb-4234-bfad-560e966de44e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93" status: 200 len: 1222 microversion: 2.1 time: 0.305645 Dec 15 13:31:06.515234 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 12/30] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:06 2021] GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93 => generated 1222 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:06.712564 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-24008c11-6c04-4a1d-a6fd-094a03260a49 tempest-VolumesSnapshotsTestJSON-445504839 tempest-VolumesSnapshotsTestJSON-445504839-project] Calling method '.version_select at 0x7ff5140a2160>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:06.751530 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-881fac0d-415f-445b-83ba-f80d2d58e2a3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'create', calling method: .version_select at 0x7ff5140c1700>, body: {"keypair": {"name": "tempest-keypair-2047121199"}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:31:06.789045 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-24008c11-6c04-4a1d-a6fd-094a03260a49 tempest-VolumesSnapshotsTestJSON-445504839 tempest-VolumesSnapshotsTestJSON-445504839-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/20b42ab9-c28e-4a78-bed7-4878dbca1b92" status: 200 len: 287 microversion: 2.1 time: 0.081064 Dec 15 13:31:06.789643 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 13/31] 10.222.0.60 () {58 vars in 1250 bytes} [Wed Dec 15 13:31:06 2021] GET /compute/v2.1/os-snapshots/20b42ab9-c28e-4a78-bed7-4878dbca1b92 => generated 287 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:31:06.820572 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-881fac0d-415f-445b-83ba-f80d2d58e2a3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Getting quotas for project 849d4c797afe475aa474e4415f6190c0. Resources: {'key_pairs'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:31:06.829865 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-881fac0d-415f-445b-83ba-f80d2d58e2a3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Getting quotas for user 58ad05b9c93c48a4bf4d1f086b6d5ad1 and project 849d4c797afe475aa474e4415f6190c0. Resources: {'key_pairs'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:31:07.001097 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-881fac0d-415f-445b-83ba-f80d2d58e2a3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Getting quotas for project 849d4c797afe475aa474e4415f6190c0. Resources: {'key_pairs'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:31:07.005355 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-881fac0d-415f-445b-83ba-f80d2d58e2a3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Getting quotas for user 58ad05b9c93c48a4bf4d1f086b6d5ad1 and project 849d4c797afe475aa474e4415f6190c0. Resources: {'key_pairs'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:31:07.039516 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-881fac0d-415f-445b-83ba-f80d2d58e2a3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.640290 Dec 15 13:31:07.040221 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 19/32] 10.222.0.60 () {62 vars in 1198 bytes} [Wed Dec 15 13:31:06 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 643 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 15 13:31:07.410997 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-acf11bb4-acf6-420a-8a75-0f76a4573ce4 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:07.412021 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-acf11bb4-acf6-420a-8a75-0f76a4573ce4 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] [instance: c3130b20-b0cc-484a-b6b4-b4719540a6a2] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:07.427759 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-acf11bb4-acf6-420a-8a75-0f76a4573ce4 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:07.432419 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-acf11bb4-acf6-420a-8a75-0f76a4573ce4 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:07.438383 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-acf11bb4-acf6-420a-8a75-0f76a4573ce4 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:07.441462 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-acf11bb4-acf6-420a-8a75-0f76a4573ce4 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:07.530869 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-a6b93eaa-6f53-41cf-8ed7-7183695c41ab tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:07.531660 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-a6b93eaa-6f53-41cf-8ed7-7183695c41ab tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 10dd91a3-b40e-4ac3-ac2c-63624e87cf93] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:07.553801 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a6b93eaa-6f53-41cf-8ed7-7183695c41ab tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:07.556569 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a6b93eaa-6f53-41cf-8ed7-7183695c41ab tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:07.567252 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a6b93eaa-6f53-41cf-8ed7-7183695c41ab tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:07.567707 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a6b93eaa-6f53-41cf-8ed7-7183695c41ab tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:07.700566 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-acf11bb4-acf6-420a-8a75-0f76a4573ce4 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07defc49f2774d9e9c7001504aa647ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6099655f06b473db6eb84adfee54156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:07.715936 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-acf11bb4-acf6-420a-8a75-0f76a4573ce4 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] 10.222.0.60 "GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2" status: 200 len: 1210 microversion: 2.1 time: 0.309325 Dec 15 13:31:07.719995 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 14/33] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:07 2021] GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2 => generated 1210 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:07.803296 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-d7055b3b-b64a-481f-825b-25d8593a9d8a tempest-VolumesSnapshotsTestJSON-445504839 tempest-VolumesSnapshotsTestJSON-445504839-project] Calling method '.version_select at 0x7ff5140a2040>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:07.871490 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-d7055b3b-b64a-481f-825b-25d8593a9d8a tempest-VolumesSnapshotsTestJSON-445504839 tempest-VolumesSnapshotsTestJSON-445504839-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/20b42ab9-c28e-4a78-bed7-4878dbca1b92" status: 200 len: 288 microversion: 2.1 time: 0.073040 Dec 15 13:31:07.872304 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 15/34] 10.222.0.60 () {58 vars in 1250 bytes} [Wed Dec 15 13:31:07 2021] GET /compute/v2.1/os-snapshots/20b42ab9-c28e-4a78-bed7-4878dbca1b92 => generated 288 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:31:07.882665 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-919101c3-3d3f-42a9-84e7-198a92d60547 tempest-VolumesSnapshotsTestJSON-445504839 tempest-VolumesSnapshotsTestJSON-445504839-project] Calling method '.version_select at 0x7ff5140cf550>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:07.943649 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-a6b93eaa-6f53-41cf-8ed7-7183695c41ab tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:07.965835 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-a6b93eaa-6f53-41cf-8ed7-7183695c41ab tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93" status: 200 len: 1214 microversion: 2.1 time: 0.436806 Dec 15 13:31:07.966543 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 20/35] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:07 2021] GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93 => generated 1214 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:31:08.107360 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-919101c3-3d3f-42a9-84e7-198a92d60547 tempest-VolumesSnapshotsTestJSON-445504839 tempest-VolumesSnapshotsTestJSON-445504839-project] 10.222.0.60 "DELETE /compute/v2.1/os-snapshots/20b42ab9-c28e-4a78-bed7-4878dbca1b92" status: 202 len: 0 microversion: 2.1 time: 0.228731 Dec 15 13:31:08.108231 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 16/36] 10.222.0.60 () {58 vars in 1253 bytes} [Wed Dec 15 13:31:07 2021] DELETE /compute/v2.1/os-snapshots/20b42ab9-c28e-4a78-bed7-4878dbca1b92 => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:31:08.116483 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-8bc28ab7-3be9-4072-9942-f6fa0d1807dd tempest-VolumesSnapshotsTestJSON-445504839 tempest-VolumesSnapshotsTestJSON-445504839-project] Calling method '.version_select at 0x7ff514064f70>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:08.167955 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-8bc28ab7-3be9-4072-9942-f6fa0d1807dd tempest-VolumesSnapshotsTestJSON-445504839 tempest-VolumesSnapshotsTestJSON-445504839-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/20b42ab9-c28e-4a78-bed7-4878dbca1b92" status: 200 len: 287 microversion: 2.1 time: 0.054996 Dec 15 13:31:08.168558 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 21/37] 10.222.0.60 () {58 vars in 1250 bytes} [Wed Dec 15 13:31:08 2021] GET /compute/v2.1/os-snapshots/20b42ab9-c28e-4a78-bed7-4878dbca1b92 => generated 287 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:31:08.736765 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-f36c6e86-c178-4ffb-9379-76499b1fa169 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:08.738268 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-f36c6e86-c178-4ffb-9379-76499b1fa169 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] [instance: c3130b20-b0cc-484a-b6b4-b4719540a6a2] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:08.753566 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f36c6e86-c178-4ffb-9379-76499b1fa169 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:08.754527 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f36c6e86-c178-4ffb-9379-76499b1fa169 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:08.756943 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f36c6e86-c178-4ffb-9379-76499b1fa169 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:08.758096 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f36c6e86-c178-4ffb-9379-76499b1fa169 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:08.962315 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-f36c6e86-c178-4ffb-9379-76499b1fa169 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07defc49f2774d9e9c7001504aa647ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6099655f06b473db6eb84adfee54156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:08.984697 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-f36c6e86-c178-4ffb-9379-76499b1fa169 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] 10.222.0.60 "GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2" status: 200 len: 1272 microversion: 2.1 time: 0.251446 Dec 15 13:31:08.988937 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-c7797749-382f-441d-ac10-2a0f93d6a5c8 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:08.990121 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-c7797749-382f-441d-ac10-2a0f93d6a5c8 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 10dd91a3-b40e-4ac3-ac2c-63624e87cf93] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:08.999527 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 17/38] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:08 2021] GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2 => generated 1272 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:09.008437 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c7797749-382f-441d-ac10-2a0f93d6a5c8 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:09.009015 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c7797749-382f-441d-ac10-2a0f93d6a5c8 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:09.010042 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c7797749-382f-441d-ac10-2a0f93d6a5c8 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:09.010503 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c7797749-382f-441d-ac10-2a0f93d6a5c8 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:09.116119 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-846a282d-bcd8-4352-a0f6-8b94a4794459 tempest-VolumesTestJSON-1526434270 tempest-VolumesTestJSON-1526434270-project] Calling method '.version_select at 0x7ff5140e1550>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:09.210105 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-846a282d-bcd8-4352-a0f6-8b94a4794459 tempest-VolumesTestJSON-1526434270 tempest-VolumesTestJSON-1526434270-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/65a11a72-abf1-49ea-94a4-ee5c312078a8" status: 200 len: 350 microversion: 2.1 time: 0.098535 Dec 15 13:31:09.210682 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 18/39] 10.222.0.60 () {58 vars in 1244 bytes} [Wed Dec 15 13:31:09 2021] GET /compute/v2.1/os-volumes/65a11a72-abf1-49ea-94a4-ee5c312078a8 => generated 350 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:31:09.215894 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-68ed3254-085d-4a1f-a6b9-2af5b66e75f2 tempest-VolumesSnapshotsTestJSON-445504839 tempest-VolumesSnapshotsTestJSON-445504839-project] Calling method '.version_select at 0x7ff51406f280>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:09.235154 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-c7797749-382f-441d-ac10-2a0f93d6a5c8 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:09.260298 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-c7797749-382f-441d-ac10-2a0f93d6a5c8 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93" status: 200 len: 1276 microversion: 2.1 time: 0.280954 Dec 15 13:31:09.263305 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 22/40] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:08 2021] GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93 => generated 1276 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:31:09.294709 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.wsgi [None req-68ed3254-085d-4a1f-a6b9-2af5b66e75f2 tempest-VolumesSnapshotsTestJSON-445504839 tempest-VolumesSnapshotsTestJSON-445504839-project] HTTP exception thrown: Snapshot 20b42ab9-c28e-4a78-bed7-4878dbca1b92 could not be found. Dec 15 13:31:09.300733 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-16ecab4f-b0fd-4cd1-bd0b-543f7d2822cf tempest-VolumesTestJSON-1526434270 tempest-VolumesTestJSON-1526434270-project] Calling method '.version_select at 0x7ff514064550>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:09.301083 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-68ed3254-085d-4a1f-a6b9-2af5b66e75f2 tempest-VolumesSnapshotsTestJSON-445504839 tempest-VolumesSnapshotsTestJSON-445504839-project] Returning 404 to user: Snapshot 20b42ab9-c28e-4a78-bed7-4878dbca1b92 could not be found. {{(pid=116942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:31:09.302326 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-68ed3254-085d-4a1f-a6b9-2af5b66e75f2 tempest-VolumesSnapshotsTestJSON-445504839 tempest-VolumesSnapshotsTestJSON-445504839-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/20b42ab9-c28e-4a78-bed7-4878dbca1b92" status: 404 len: 111 microversion: 2.1 time: 0.090290 Dec 15 13:31:09.307614 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 19/41] 10.222.0.60 () {58 vars in 1250 bytes} [Wed Dec 15 13:31:09 2021] GET /compute/v2.1/os-snapshots/20b42ab9-c28e-4a78-bed7-4878dbca1b92 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:31:09.319204 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-b7087afd-64bd-40b1-aab3-6908929ef461 tempest-VolumesSnapshotsTestJSON-445504839 tempest-VolumesSnapshotsTestJSON-445504839-project] Calling method '.version_select at 0x7ff51406f4c0>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:09.605687 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-16ecab4f-b0fd-4cd1-bd0b-543f7d2822cf tempest-VolumesTestJSON-1526434270 tempest-VolumesTestJSON-1526434270-project] 10.222.0.60 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.324122 Dec 15 13:31:09.606388 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 23/42] 10.222.0.60 () {58 vars in 1133 bytes} [Wed Dec 15 13:31:09 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:09.620315 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-38a184e8-6c15-4c68-a1c0-724bd74626e4 tempest-VolumesTestJSON-1526434270 tempest-VolumesTestJSON-1526434270-project] Calling method '.version_select at 0x7ff5140a1430>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:09.861040 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-b7087afd-64bd-40b1-aab3-6908929ef461 tempest-VolumesSnapshotsTestJSON-445504839 tempest-VolumesSnapshotsTestJSON-445504839-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/4d36a5a9-fc2f-4a61-bc73-91e81f0f1149" status: 202 len: 0 microversion: 2.1 time: 0.552021 Dec 15 13:31:09.865056 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 20/43] 10.222.0.60 () {58 vars in 1247 bytes} [Wed Dec 15 13:31:09 2021] DELETE /compute/v2.1/os-volumes/4d36a5a9-fc2f-4a61-bc73-91e81f0f1149 => generated 0 bytes in 556 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:31:09.871012 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-5852c3ec-5f0c-48d8-80f9-3ced052a7881 tempest-VolumesSnapshotsTestJSON-445504839 tempest-VolumesSnapshotsTestJSON-445504839-project] Calling method '.version_select at 0x7ff5140e10d0>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:10.126546 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-5852c3ec-5f0c-48d8-80f9-3ced052a7881 tempest-VolumesSnapshotsTestJSON-445504839 tempest-VolumesSnapshotsTestJSON-445504839-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/4d36a5a9-fc2f-4a61-bc73-91e81f0f1149" status: 200 len: 344 microversion: 2.1 time: 0.259637 Dec 15 13:31:10.127305 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 21/44] 10.222.0.60 () {58 vars in 1244 bytes} [Wed Dec 15 13:31:09 2021] GET /compute/v2.1/os-volumes/4d36a5a9-fc2f-4a61-bc73-91e81f0f1149 => generated 344 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:31:10.132509 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-7571dd3c-b2c2-4dbb-833b-b7a3e2a67cd4 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:10.133366 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-7571dd3c-b2c2-4dbb-833b-b7a3e2a67cd4 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] [instance: c3130b20-b0cc-484a-b6b4-b4719540a6a2] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:10.154297 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7571dd3c-b2c2-4dbb-833b-b7a3e2a67cd4 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:10.157901 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7571dd3c-b2c2-4dbb-833b-b7a3e2a67cd4 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:10.161133 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7571dd3c-b2c2-4dbb-833b-b7a3e2a67cd4 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:10.163145 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7571dd3c-b2c2-4dbb-833b-b7a3e2a67cd4 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:10.350747 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-38a184e8-6c15-4c68-a1c0-724bd74626e4 tempest-VolumesTestJSON-1526434270 tempest-VolumesTestJSON-1526434270-project] 10.222.0.60 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.734621 Dec 15 13:31:10.359913 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 24/45] 10.222.0.60 () {58 vars in 1148 bytes} [Wed Dec 15 13:31:09 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:31:10.366260 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-b1b8b2ee-f93f-48cf-bea4-4537465e7e93 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:10.369679 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-b1b8b2ee-f93f-48cf-bea4-4537465e7e93 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 10dd91a3-b40e-4ac3-ac2c-63624e87cf93] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:10.380737 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b1b8b2ee-f93f-48cf-bea4-4537465e7e93 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:10.381548 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b1b8b2ee-f93f-48cf-bea4-4537465e7e93 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:10.383150 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b1b8b2ee-f93f-48cf-bea4-4537465e7e93 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:10.383823 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b1b8b2ee-f93f-48cf-bea4-4537465e7e93 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:10.468193 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-7571dd3c-b2c2-4dbb-833b-b7a3e2a67cd4 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07defc49f2774d9e9c7001504aa647ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6099655f06b473db6eb84adfee54156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:10.485009 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-7571dd3c-b2c2-4dbb-833b-b7a3e2a67cd4 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] 10.222.0.60 "GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2" status: 200 len: 1272 microversion: 2.1 time: 0.354651 Dec 15 13:31:10.492204 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 22/46] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:10 2021] GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2 => generated 1272 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:10.511310 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-aacee91f-1f56-445a-8b7c-2059aac8ea8c tempest-VolumesTestJSON-1526434270 tempest-VolumesTestJSON-1526434270-project] Calling method '.version_select at 0x7ff51406fb80>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:10.726387 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-aacee91f-1f56-445a-8b7c-2059aac8ea8c tempest-VolumesTestJSON-1526434270 tempest-VolumesTestJSON-1526434270-project] 10.222.0.60 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.232172 Dec 15 13:31:10.726992 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 23/47] 10.222.0.60 () {58 vars in 1133 bytes} [Wed Dec 15 13:31:10 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:10.739192 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-7d502df4-c6d0-4ae9-a216-4d50e3edbac7 tempest-VolumesTestJSON-1526434270 tempest-VolumesTestJSON-1526434270-project] Calling method '.version_select at 0x7ff514080790>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:10.823215 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-b1b8b2ee-f93f-48cf-bea4-4537465e7e93 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:10.846542 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-b1b8b2ee-f93f-48cf-bea4-4537465e7e93 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93" status: 200 len: 1276 microversion: 2.1 time: 0.483428 Dec 15 13:31:10.852905 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 25/48] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:10 2021] GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93 => generated 1276 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:10.993678 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-7d502df4-c6d0-4ae9-a216-4d50e3edbac7 tempest-VolumesTestJSON-1526434270 tempest-VolumesTestJSON-1526434270-project] 10.222.0.60 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.258930 Dec 15 13:31:11.003613 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 24/49] 10.222.0.60 () {58 vars in 1166 bytes} [Wed Dec 15 13:31:10 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:31:11.008621 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-1994b0ac-9861-4b40-a545-e577db9b31a6 tempest-VolumesTestJSON-1526434270 tempest-VolumesTestJSON-1526434270-project] Calling method '.version_select at 0x7ff514064b80>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:11.140968 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-1e1a68d3-dc79-4e27-9940-cc98c47b872d tempest-VolumesSnapshotsTestJSON-445504839 tempest-VolumesSnapshotsTestJSON-445504839-project] Calling method '.version_select at 0x7ff5140b30d0>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:11.234655 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-1994b0ac-9861-4b40-a545-e577db9b31a6 tempest-VolumesTestJSON-1526434270 tempest-VolumesTestJSON-1526434270-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.231100 Dec 15 13:31:11.235320 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 26/50] 10.222.0.60 () {58 vars in 1169 bytes} [Wed Dec 15 13:31:11 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:31:11.238234 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.wsgi [None req-1e1a68d3-dc79-4e27-9940-cc98c47b872d tempest-VolumesSnapshotsTestJSON-445504839 tempest-VolumesSnapshotsTestJSON-445504839-project] HTTP exception thrown: Volume 4d36a5a9-fc2f-4a61-bc73-91e81f0f1149 could not be found. Dec 15 13:31:11.238881 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-1e1a68d3-dc79-4e27-9940-cc98c47b872d tempest-VolumesSnapshotsTestJSON-445504839 tempest-VolumesSnapshotsTestJSON-445504839-project] Returning 404 to user: Volume 4d36a5a9-fc2f-4a61-bc73-91e81f0f1149 could not be found. {{(pid=116942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:31:11.239738 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-1e1a68d3-dc79-4e27-9940-cc98c47b872d tempest-VolumesSnapshotsTestJSON-445504839 tempest-VolumesSnapshotsTestJSON-445504839-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/4d36a5a9-fc2f-4a61-bc73-91e81f0f1149" status: 404 len: 109 microversion: 2.1 time: 0.103502 Dec 15 13:31:11.240521 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 25/51] 10.222.0.60 () {58 vars in 1244 bytes} [Wed Dec 15 13:31:11 2021] GET /compute/v2.1/os-volumes/4d36a5a9-fc2f-4a61-bc73-91e81f0f1149 => generated 109 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:31:11.250060 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-6f783f4f-b74d-447b-98f8-1af569a17270 tempest-VolumesTestJSON-1526434270 tempest-VolumesTestJSON-1526434270-project] Calling method '.version_select at 0x7ff5140a1af0>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:11.257474 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-f6b1a842-5e97-432e-9f75-7418a6748ce2 tempest-VolumesSnapshotsTestJSON-445504839 tempest-VolumesSnapshotsTestJSON-445504839-project] Calling method '.version_select at 0x7ff5140b34c0>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:11.400391 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.wsgi [None req-f6b1a842-5e97-432e-9f75-7418a6748ce2 tempest-VolumesSnapshotsTestJSON-445504839 tempest-VolumesSnapshotsTestJSON-445504839-project] HTTP exception thrown: Volume 4d36a5a9-fc2f-4a61-bc73-91e81f0f1149 could not be found. Dec 15 13:31:11.401182 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-f6b1a842-5e97-432e-9f75-7418a6748ce2 tempest-VolumesSnapshotsTestJSON-445504839 tempest-VolumesSnapshotsTestJSON-445504839-project] Returning 404 to user: Volume 4d36a5a9-fc2f-4a61-bc73-91e81f0f1149 could not be found. {{(pid=116942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:31:11.402251 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-f6b1a842-5e97-432e-9f75-7418a6748ce2 tempest-VolumesSnapshotsTestJSON-445504839 tempest-VolumesSnapshotsTestJSON-445504839-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/4d36a5a9-fc2f-4a61-bc73-91e81f0f1149" status: 404 len: 109 microversion: 2.1 time: 0.148940 Dec 15 13:31:11.403066 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 26/52] 10.222.0.60 () {58 vars in 1247 bytes} [Wed Dec 15 13:31:11 2021] DELETE /compute/v2.1/os-volumes/4d36a5a9-fc2f-4a61-bc73-91e81f0f1149 => generated 109 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:31:11.411840 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-537b5171-4ac9-4f71-989f-bcef27c5aeeb tempest-VolumesSnapshotsTestJSON-445504839 tempest-VolumesSnapshotsTestJSON-445504839-project] Calling method '.version_select at 0x7ff51497fdc0>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:11.543920 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-6f783f4f-b74d-447b-98f8-1af569a17270 tempest-VolumesTestJSON-1526434270 tempest-VolumesTestJSON-1526434270-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.300419 Dec 15 13:31:11.545806 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 27/53] 10.222.0.60 () {58 vars in 1154 bytes} [Wed Dec 15 13:31:11 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:11.551404 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-8d8c837d-dc02-474f-9afe-2d55ae14527d tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:11.552615 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-8d8c837d-dc02-474f-9afe-2d55ae14527d tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] [instance: c3130b20-b0cc-484a-b6b4-b4719540a6a2] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:11.579804 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.wsgi [None req-537b5171-4ac9-4f71-989f-bcef27c5aeeb tempest-VolumesSnapshotsTestJSON-445504839 tempest-VolumesSnapshotsTestJSON-445504839-project] HTTP exception thrown: Volume 4d36a5a9-fc2f-4a61-bc73-91e81f0f1149 could not be found. Dec 15 13:31:11.580482 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-537b5171-4ac9-4f71-989f-bcef27c5aeeb tempest-VolumesSnapshotsTestJSON-445504839 tempest-VolumesSnapshotsTestJSON-445504839-project] Returning 404 to user: Volume 4d36a5a9-fc2f-4a61-bc73-91e81f0f1149 could not be found. {{(pid=116942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:31:11.581410 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-537b5171-4ac9-4f71-989f-bcef27c5aeeb tempest-VolumesSnapshotsTestJSON-445504839 tempest-VolumesSnapshotsTestJSON-445504839-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/4d36a5a9-fc2f-4a61-bc73-91e81f0f1149" status: 404 len: 109 microversion: 2.1 time: 0.173849 Dec 15 13:31:11.581993 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 27/54] 10.222.0.60 () {58 vars in 1244 bytes} [Wed Dec 15 13:31:11 2021] GET /compute/v2.1/os-volumes/4d36a5a9-fc2f-4a61-bc73-91e81f0f1149 => generated 109 bytes in 175 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:31:11.588863 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8d8c837d-dc02-474f-9afe-2d55ae14527d tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:11.593635 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8d8c837d-dc02-474f-9afe-2d55ae14527d tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:11.598722 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8d8c837d-dc02-474f-9afe-2d55ae14527d tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:11.600016 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8d8c837d-dc02-474f-9afe-2d55ae14527d tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:11.601166 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-42bd2318-231c-41df-a5e1-6d127deaff10 tempest-VolumesTestJSON-1526434270 tempest-VolumesTestJSON-1526434270-project] Calling method '.version_select at 0x7ff5140809d0>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:11.789604 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-8d8c837d-dc02-474f-9afe-2d55ae14527d tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07defc49f2774d9e9c7001504aa647ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6099655f06b473db6eb84adfee54156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:11.808317 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-8d8c837d-dc02-474f-9afe-2d55ae14527d tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] 10.222.0.60 "GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2" status: 200 len: 1272 microversion: 2.1 time: 0.252574 Dec 15 13:31:11.809219 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 28/55] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:11 2021] GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2 => generated 1272 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:11.827936 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-bbe83bc6-5202-4c0e-a16d-b0a722adae62 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-662431289", "imageRef": "cfccedbb-7169-47ec-9bae-d4829cba54e1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b0016a0f-1988-46ad-b4da-048d7988271c"}], "security_groups": [{"name": "tempest-securitygroup--1369264690"}], "key_name": "tempest-keypair-2047121199", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:31:11.981371 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-42bd2318-231c-41df-a5e1-6d127deaff10 tempest-VolumesTestJSON-1526434270 tempest-VolumesTestJSON-1526434270-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.392089 Dec 15 13:31:11.982184 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 28/56] 10.222.0.60 () {58 vars in 1187 bytes} [Wed Dec 15 13:31:11 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:31:11.987759 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-d5dec129-f90b-4372-9581-0732480b8dfa tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:11.989156 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-d5dec129-f90b-4372-9581-0732480b8dfa tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 10dd91a3-b40e-4ac3-ac2c-63624e87cf93] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:12.007536 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d5dec129-f90b-4372-9581-0732480b8dfa tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:12.008075 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d5dec129-f90b-4372-9581-0732480b8dfa tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:12.008817 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d5dec129-f90b-4372-9581-0732480b8dfa tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:12.009326 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d5dec129-f90b-4372-9581-0732480b8dfa tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:12.307243 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-d5dec129-f90b-4372-9581-0732480b8dfa tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:12.323729 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-d5dec129-f90b-4372-9581-0732480b8dfa tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93" status: 200 len: 1276 microversion: 2.1 time: 0.339185 Dec 15 13:31:12.327743 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 29/57] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:11 2021] GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93 => generated 1276 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:12.360534 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-62a94261-bfee-4c9d-84b0-026177bfab3a tempest-VolumesTestJSON-1526434270 tempest-VolumesTestJSON-1526434270-project] Calling method '.version_select at 0x7ff51497fdc0>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:12.363902 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.network.neutron [None req-bbe83bc6-5202-4c0e-a16d-b0a722adae62 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] validate_networks() for [('b0016a0f-1988-46ad-b4da-048d7988271c', None, None, None, None, None)] {{(pid=116941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:31:12.709814 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-62a94261-bfee-4c9d-84b0-026177bfab3a tempest-VolumesTestJSON-1526434270 tempest-VolumesTestJSON-1526434270-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.371486 Dec 15 13:31:12.722037 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 30/58] 10.222.0.60 () {58 vars in 1154 bytes} [Wed Dec 15 13:31:12 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:12.827632 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-a9069caf-c3f8-48cb-b97c-5fec2b207bf4 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:12.828253 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-a9069caf-c3f8-48cb-b97c-5fec2b207bf4 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] [instance: c3130b20-b0cc-484a-b6b4-b4719540a6a2] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:12.848336 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a9069caf-c3f8-48cb-b97c-5fec2b207bf4 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:12.848785 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a9069caf-c3f8-48cb-b97c-5fec2b207bf4 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:12.849582 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a9069caf-c3f8-48cb-b97c-5fec2b207bf4 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:12.850024 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a9069caf-c3f8-48cb-b97c-5fec2b207bf4 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:13.125435 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-a9069caf-c3f8-48cb-b97c-5fec2b207bf4 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07defc49f2774d9e9c7001504aa647ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6099655f06b473db6eb84adfee54156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:13.146751 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-a9069caf-c3f8-48cb-b97c-5fec2b207bf4 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] 10.222.0.60 "GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2" status: 200 len: 1272 microversion: 2.1 time: 0.321974 Dec 15 13:31:13.150616 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 31/59] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:12 2021] GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2 => generated 1272 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:31:13.347820 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-1b9816e3-c9c5-4e1a-9bd9-a3088201627a tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:13.348457 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-1b9816e3-c9c5-4e1a-9bd9-a3088201627a tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 10dd91a3-b40e-4ac3-ac2c-63624e87cf93] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:13.402906 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1b9816e3-c9c5-4e1a-9bd9-a3088201627a tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:13.403954 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1b9816e3-c9c5-4e1a-9bd9-a3088201627a tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:13.408153 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1b9816e3-c9c5-4e1a-9bd9-a3088201627a tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:13.408761 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1b9816e3-c9c5-4e1a-9bd9-a3088201627a tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:14.350253 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-bbe83bc6-5202-4c0e-a16d-b0a722adae62 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Flavor limits 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:31:14.351341 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-bbe83bc6-5202-4c0e-a16d-b0a722adae62 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Image limits 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:31:14.352002 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-bbe83bc6-5202-4c0e-a16d-b0a722adae62 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Flavor pref 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:31:14.352560 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-bbe83bc6-5202-4c0e-a16d-b0a722adae62 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Image pref 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:31:14.353309 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-bbe83bc6-5202-4c0e-a16d-b0a722adae62 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:31:14.380458 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-1b9816e3-c9c5-4e1a-9bd9-a3088201627a tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:14.392286 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bbe83bc6-5202-4c0e-a16d-b0a722adae62 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:14.392976 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bbe83bc6-5202-4c0e-a16d-b0a722adae62 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:14.393237 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-1b9816e3-c9c5-4e1a-9bd9-a3088201627a tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93" status: 200 len: 1276 microversion: 2.1 time: 1.050582 Dec 15 13:31:14.395534 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bbe83bc6-5202-4c0e-a16d-b0a722adae62 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:14.396879 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bbe83bc6-5202-4c0e-a16d-b0a722adae62 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:14.410603 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 32/60] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:13 2021] GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93 => generated 1276 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:14.416196 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-a2406f5f-d44b-436e-8647-d29e23492a4f tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:14.417208 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-a2406f5f-d44b-436e-8647-d29e23492a4f tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] [instance: c3130b20-b0cc-484a-b6b4-b4719540a6a2] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:14.434019 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a2406f5f-d44b-436e-8647-d29e23492a4f tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:14.435387 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a2406f5f-d44b-436e-8647-d29e23492a4f tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:14.436592 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a2406f5f-d44b-436e-8647-d29e23492a4f tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:14.438950 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a2406f5f-d44b-436e-8647-d29e23492a4f tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:14.441530 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-bbe83bc6-5202-4c0e-a16d-b0a722adae62 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Getting quotas for project 849d4c797afe475aa474e4415f6190c0. Resources: {'cores', 'instances', 'ram'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:31:14.453650 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-bbe83bc6-5202-4c0e-a16d-b0a722adae62 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Getting quotas for user 58ad05b9c93c48a4bf4d1f086b6d5ad1 and project 849d4c797afe475aa474e4415f6190c0. Resources: {'cores', 'instances', 'ram'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:31:14.519390 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-bbe83bc6-5202-4c0e-a16d-b0a722adae62 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Going to run 1 instances... {{(pid=116941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:31:14.537103 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-bbe83bc6-5202-4c0e-a16d-b0a722adae62 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cfccedbb-7169-47ec-9bae-d4829cba54e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:31:14.631526 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-a2406f5f-d44b-436e-8647-d29e23492a4f tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07defc49f2774d9e9c7001504aa647ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6099655f06b473db6eb84adfee54156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:14.640915 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-a2406f5f-d44b-436e-8647-d29e23492a4f tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] 10.222.0.60 "GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2" status: 200 len: 1272 microversion: 2.1 time: 0.228945 Dec 15 13:31:14.647627 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 33/61] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:14 2021] GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2 => generated 1272 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:14.705798 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-bbe83bc6-5202-4c0e-a16d-b0a722adae62 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.879000 Dec 15 13:31:14.707211 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 29/62] 10.222.0.60 () {62 vars in 1187 bytes} [Wed Dec 15 13:31:11 2021] POST /compute/v2.1/servers => generated 402 bytes in 2897 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 15 13:31:14.721335 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-e2d50916-eaaa-4b6b-b91a-e6c209faf268 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:14.721997 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-e2d50916-eaaa-4b6b-b91a-e6c209faf268 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:14.939966 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-e2d50916-eaaa-4b6b-b91a-e6c209faf268 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:14.954830 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-e2d50916-eaaa-4b6b-b91a-e6c209faf268 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:14.956700 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-e2d50916-eaaa-4b6b-b91a-e6c209faf268 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:14.959610 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-e2d50916-eaaa-4b6b-b91a-e6c209faf268 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1281 microversion: 2.20 time: 0.242706 Dec 15 13:31:14.966165 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 34/63] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:31:14 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1281 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:31:15.128274 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-4718b212-1b55-49d5-bc21-55e9f2c37be8 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'create', calling method: .version_select at 0x7ff5140b7700>, body: {"keypair": {"name": "tempest-keypair-1233220904"}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:31:15.236852 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-4718b212-1b55-49d5-bc21-55e9f2c37be8 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Getting quotas for project 4cde9c0e34334ad7a7e79bfeb8963935. Resources: {'key_pairs'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:31:15.272357 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-4718b212-1b55-49d5-bc21-55e9f2c37be8 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Getting quotas for user e2f51c315df74089bc6873e889cf80d7 and project 4cde9c0e34334ad7a7e79bfeb8963935. Resources: {'key_pairs'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:31:15.411991 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-38caf017-79a3-4c29-88d9-143a3b81e666 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:15.412618 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-38caf017-79a3-4c29-88d9-143a3b81e666 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 10dd91a3-b40e-4ac3-ac2c-63624e87cf93] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:15.420165 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-38caf017-79a3-4c29-88d9-143a3b81e666 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:15.420608 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-38caf017-79a3-4c29-88d9-143a3b81e666 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:15.434526 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-38caf017-79a3-4c29-88d9-143a3b81e666 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:15.435183 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-38caf017-79a3-4c29-88d9-143a3b81e666 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:15.667241 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-38caf017-79a3-4c29-88d9-143a3b81e666 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:15.675221 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-38caf017-79a3-4c29-88d9-143a3b81e666 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93" status: 200 len: 1276 microversion: 2.1 time: 0.266923 Dec 15 13:31:15.675826 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 35/64] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:15 2021] GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93 => generated 1276 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:15.698180 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-a27f5593-e21b-4c4b-be47-ffafa5742791 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:15.705299 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-a27f5593-e21b-4c4b-be47-ffafa5742791 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] [instance: c3130b20-b0cc-484a-b6b4-b4719540a6a2] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:15.733152 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a27f5593-e21b-4c4b-be47-ffafa5742791 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:15.739357 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a27f5593-e21b-4c4b-be47-ffafa5742791 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:15.741063 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a27f5593-e21b-4c4b-be47-ffafa5742791 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:15.744726 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a27f5593-e21b-4c4b-be47-ffafa5742791 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:16.058656 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-4718b212-1b55-49d5-bc21-55e9f2c37be8 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Getting quotas for project 4cde9c0e34334ad7a7e79bfeb8963935. Resources: {'key_pairs'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:31:16.074886 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-4718b212-1b55-49d5-bc21-55e9f2c37be8 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Getting quotas for user e2f51c315df74089bc6873e889cf80d7 and project 4cde9c0e34334ad7a7e79bfeb8963935. Resources: {'key_pairs'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:31:16.128424 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-4718b212-1b55-49d5-bc21-55e9f2c37be8 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 1.310854 Dec 15 13:31:16.132834 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 30/65] 10.222.0.60 () {60 vars in 1157 bytes} [Wed Dec 15 13:31:14 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:16.137952 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-ac96d09a-ed38-4805-862b-1845d28e1902 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:16.148692 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-ac96d09a-ed38-4805-862b-1845d28e1902 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:16.175997 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ac96d09a-ed38-4805-862b-1845d28e1902 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:16.184516 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ac96d09a-ed38-4805-862b-1845d28e1902 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:16.185833 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ac96d09a-ed38-4805-862b-1845d28e1902 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:16.188134 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ac96d09a-ed38-4805-862b-1845d28e1902 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:16.352009 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-a27f5593-e21b-4c4b-be47-ffafa5742791 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07defc49f2774d9e9c7001504aa647ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6099655f06b473db6eb84adfee54156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:16.366010 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-a27f5593-e21b-4c4b-be47-ffafa5742791 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] 10.222.0.60 "GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2" status: 200 len: 1314 microversion: 2.1 time: 0.676069 Dec 15 13:31:16.383107 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 36/66] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:15 2021] GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2 => generated 1314 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:16.535715 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-ac96d09a-ed38-4805-862b-1845d28e1902 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:16.601072 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-ac96d09a-ed38-4805-862b-1845d28e1902 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:16.611717 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-ac96d09a-ed38-4805-862b-1845d28e1902 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:16.618774 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-ac96d09a-ed38-4805-862b-1845d28e1902 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1285 microversion: 2.20 time: 0.480851 Dec 15 13:31:16.621525 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 31/67] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:31:16 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1285 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:31:16.699354 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-65841785-4cef-442f-9e11-cd6b3060821c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:16.700093 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-65841785-4cef-442f-9e11-cd6b3060821c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 10dd91a3-b40e-4ac3-ac2c-63624e87cf93] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:16.716240 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-65841785-4cef-442f-9e11-cd6b3060821c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:16.724803 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-65841785-4cef-442f-9e11-cd6b3060821c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:16.728993 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-65841785-4cef-442f-9e11-cd6b3060821c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:16.734035 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-65841785-4cef-442f-9e11-cd6b3060821c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:17.394285 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-77ab5ca2-ac42-4733-8053-1a6304f83cc1 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:17.394285 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-77ab5ca2-ac42-4733-8053-1a6304f83cc1 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] [instance: c3130b20-b0cc-484a-b6b4-b4719540a6a2] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:17.409999 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-77ab5ca2-ac42-4733-8053-1a6304f83cc1 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:17.410887 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-77ab5ca2-ac42-4733-8053-1a6304f83cc1 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:17.415454 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-77ab5ca2-ac42-4733-8053-1a6304f83cc1 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:17.417640 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-77ab5ca2-ac42-4733-8053-1a6304f83cc1 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:17.706184 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-65841785-4cef-442f-9e11-cd6b3060821c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:17.717371 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-65841785-4cef-442f-9e11-cd6b3060821c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93" status: 200 len: 1318 microversion: 2.1 time: 1.024962 Dec 15 13:31:17.738473 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 37/68] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:16 2021] GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93 => generated 1318 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:17.743182 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-da2ccbca-fdc3-4fe7-a30f-2c087f5655f4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:17.753615 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-da2ccbca-fdc3-4fe7-a30f-2c087f5655f4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:17.778190 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-da2ccbca-fdc3-4fe7-a30f-2c087f5655f4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:17.778933 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-da2ccbca-fdc3-4fe7-a30f-2c087f5655f4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:17.782394 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-da2ccbca-fdc3-4fe7-a30f-2c087f5655f4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:17.790252 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-da2ccbca-fdc3-4fe7-a30f-2c087f5655f4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:18.198104 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-da2ccbca-fdc3-4fe7-a30f-2c087f5655f4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:18.218661 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-da2ccbca-fdc3-4fe7-a30f-2c087f5655f4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:18.220702 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-da2ccbca-fdc3-4fe7-a30f-2c087f5655f4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:18.222042 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-da2ccbca-fdc3-4fe7-a30f-2c087f5655f4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1339 microversion: 2.20 time: 0.482518 Dec 15 13:31:18.222782 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 38/69] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:31:17 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1339 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:31:18.453660 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-77ab5ca2-ac42-4733-8053-1a6304f83cc1 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07defc49f2774d9e9c7001504aa647ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6099655f06b473db6eb84adfee54156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:18.463145 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-77ab5ca2-ac42-4733-8053-1a6304f83cc1 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] 10.222.0.60 "GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2" status: 200 len: 1314 microversion: 2.1 time: 1.076968 Dec 15 13:31:18.473365 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 32/70] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:17 2021] GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2 => generated 1314 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:18.748253 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-0f7a33a8-2e43-41a1-b8d7-261371496204 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:18.749437 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-0f7a33a8-2e43-41a1-b8d7-261371496204 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 10dd91a3-b40e-4ac3-ac2c-63624e87cf93] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:18.766242 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0f7a33a8-2e43-41a1-b8d7-261371496204 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:18.773047 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0f7a33a8-2e43-41a1-b8d7-261371496204 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:18.775087 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0f7a33a8-2e43-41a1-b8d7-261371496204 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:18.776006 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0f7a33a8-2e43-41a1-b8d7-261371496204 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:19.247900 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-fcec5c7a-3ce0-4fe4-981d-0e0c7a09ecc3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:19.253323 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-fcec5c7a-3ce0-4fe4-981d-0e0c7a09ecc3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:19.261245 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-fcec5c7a-3ce0-4fe4-981d-0e0c7a09ecc3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:19.261933 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-fcec5c7a-3ce0-4fe4-981d-0e0c7a09ecc3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:19.262894 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-fcec5c7a-3ce0-4fe4-981d-0e0c7a09ecc3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:19.264149 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-fcec5c7a-3ce0-4fe4-981d-0e0c7a09ecc3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:19.531839 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-fcec5c7a-3ce0-4fe4-981d-0e0c7a09ecc3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:19.549311 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-fcec5c7a-3ce0-4fe4-981d-0e0c7a09ecc3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:19.555886 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-fcec5c7a-3ce0-4fe4-981d-0e0c7a09ecc3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:19.557157 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-fcec5c7a-3ce0-4fe4-981d-0e0c7a09ecc3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1339 microversion: 2.20 time: 0.320605 Dec 15 13:31:19.561337 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 33/71] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:31:19 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1339 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:31:19.574942 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-0d18051a-dd48-4f90-9d55-fc60c923fd7b tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:19.582336 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-0d18051a-dd48-4f90-9d55-fc60c923fd7b tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] [instance: c3130b20-b0cc-484a-b6b4-b4719540a6a2] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:19.606135 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0d18051a-dd48-4f90-9d55-fc60c923fd7b tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:19.606801 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0d18051a-dd48-4f90-9d55-fc60c923fd7b tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:19.609895 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0d18051a-dd48-4f90-9d55-fc60c923fd7b tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:19.610349 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0d18051a-dd48-4f90-9d55-fc60c923fd7b tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:19.922491 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-0f7a33a8-2e43-41a1-b8d7-261371496204 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:19.949489 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-0f7a33a8-2e43-41a1-b8d7-261371496204 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93" status: 200 len: 1318 microversion: 2.1 time: 1.206074 Dec 15 13:31:19.950344 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 39/72] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:18 2021] GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93 => generated 1318 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:20.586686 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-1a5be158-76b1-450e-b669-9829ec70f78a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:20.592009 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-1a5be158-76b1-450e-b669-9829ec70f78a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:20.619749 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1a5be158-76b1-450e-b669-9829ec70f78a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:20.626117 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1a5be158-76b1-450e-b669-9829ec70f78a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:20.627592 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1a5be158-76b1-450e-b669-9829ec70f78a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:20.631407 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1a5be158-76b1-450e-b669-9829ec70f78a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:21.009041 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-1a5be158-76b1-450e-b669-9829ec70f78a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:21.025389 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-1a5be158-76b1-450e-b669-9829ec70f78a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:21.029557 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-1a5be158-76b1-450e-b669-9829ec70f78a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:21.032542 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-1a5be158-76b1-450e-b669-9829ec70f78a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1339 microversion: 2.20 time: 0.457599 Dec 15 13:31:21.038146 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 40/73] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:31:20 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1339 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:31:21.051830 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-d9bfbfc5-ff45-4eee-9eb7-dc12234848d1 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:21.054114 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-d9bfbfc5-ff45-4eee-9eb7-dc12234848d1 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 10dd91a3-b40e-4ac3-ac2c-63624e87cf93] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:21.078598 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d9bfbfc5-ff45-4eee-9eb7-dc12234848d1 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:21.079843 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d9bfbfc5-ff45-4eee-9eb7-dc12234848d1 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:21.082528 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d9bfbfc5-ff45-4eee-9eb7-dc12234848d1 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:21.083205 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d9bfbfc5-ff45-4eee-9eb7-dc12234848d1 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:21.116270 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-0d18051a-dd48-4f90-9d55-fc60c923fd7b tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07defc49f2774d9e9c7001504aa647ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6099655f06b473db6eb84adfee54156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:21.127820 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-0d18051a-dd48-4f90-9d55-fc60c923fd7b tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] 10.222.0.60 "GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2" status: 200 len: 1314 microversion: 2.1 time: 1.560998 Dec 15 13:31:21.130153 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 34/74] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:19 2021] GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2 => generated 1314 bytes in 1568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:21.764175 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-65395bf2-c684-4248-9ffd-e73633286043 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1022425716", "imageRef": "cfccedbb-7169-47ec-9bae-d4829cba54e1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "818413aa-89a4-4338-a133-8010a51bc5a9"}]}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:31:21.888280 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.network.neutron [None req-65395bf2-c684-4248-9ffd-e73633286043 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] validate_networks() for [('818413aa-89a4-4338-a133-8010a51bc5a9', None, None, None, None, None)] {{(pid=116941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:31:22.812385 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-d9bfbfc5-ff45-4eee-9eb7-dc12234848d1 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:22.823491 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-d9bfbfc5-ff45-4eee-9eb7-dc12234848d1 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93" status: 200 len: 1318 microversion: 2.1 time: 1.783875 Dec 15 13:31:22.839014 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 41/75] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:21 2021] GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93 => generated 1318 bytes in 1800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:22.844429 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-cd6d2a09-38ec-4917-8a22-24c786105d32 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:22.850397 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-cd6d2a09-38ec-4917-8a22-24c786105d32 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:22.864083 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-cd6d2a09-38ec-4917-8a22-24c786105d32 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:22.865621 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-cd6d2a09-38ec-4917-8a22-24c786105d32 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:22.870134 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-cd6d2a09-38ec-4917-8a22-24c786105d32 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:22.871022 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-cd6d2a09-38ec-4917-8a22-24c786105d32 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:23.154553 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-cd6d2a09-38ec-4917-8a22-24c786105d32 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:23.168456 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-cd6d2a09-38ec-4917-8a22-24c786105d32 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:23.172616 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-cd6d2a09-38ec-4917-8a22-24c786105d32 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:23.175111 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-cd6d2a09-38ec-4917-8a22-24c786105d32 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1339 microversion: 2.20 time: 0.334789 Dec 15 13:31:23.189293 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 42/76] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:31:22 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1339 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:31:23.190531 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-fea707d7-09b5-43d4-9c69-17fe2d6e2d1e tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:23.192901 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-fea707d7-09b5-43d4-9c69-17fe2d6e2d1e tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] [instance: c3130b20-b0cc-484a-b6b4-b4719540a6a2] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:23.219651 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-fea707d7-09b5-43d4-9c69-17fe2d6e2d1e tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:23.224148 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-fea707d7-09b5-43d4-9c69-17fe2d6e2d1e tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:23.225201 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-fea707d7-09b5-43d4-9c69-17fe2d6e2d1e tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:23.226447 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-fea707d7-09b5-43d4-9c69-17fe2d6e2d1e tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:24.005074 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-fea707d7-09b5-43d4-9c69-17fe2d6e2d1e tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07defc49f2774d9e9c7001504aa647ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6099655f06b473db6eb84adfee54156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:24.014728 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-fea707d7-09b5-43d4-9c69-17fe2d6e2d1e tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] 10.222.0.60 "GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2" status: 200 len: 1314 microversion: 2.1 time: 0.834229 Dec 15 13:31:24.029874 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 43/77] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:23 2021] GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2 => generated 1314 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:24.411614 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-65395bf2-c684-4248-9ffd-e73633286043 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Flavor limits 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:31:24.412193 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-65395bf2-c684-4248-9ffd-e73633286043 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Image limits 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:31:24.412519 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-65395bf2-c684-4248-9ffd-e73633286043 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Flavor pref 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:31:24.413093 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-65395bf2-c684-4248-9ffd-e73633286043 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Image pref 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:31:24.413948 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-65395bf2-c684-4248-9ffd-e73633286043 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:31:24.483519 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-65395bf2-c684-4248-9ffd-e73633286043 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:24.492432 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-65395bf2-c684-4248-9ffd-e73633286043 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:24.499028 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-65395bf2-c684-4248-9ffd-e73633286043 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:24.504906 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-65395bf2-c684-4248-9ffd-e73633286043 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:24.559986 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-a6f379aa-51c0-41c8-b23f-a7f12ac7efca req-7e772124-1af6-4033-a6b4-b486df3c101b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10dd91a3-b40e-4ac3-ac2c-63624e87cf93", "tag": "3c89bced-e266-4c30-8918-8d80f7f8660a"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:31:24.563615 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:31:24.563615 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: warnings.warn(msg) Dec 15 13:31:24.588889 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-a6f379aa-51c0-41c8-b23f-a7f12ac7efca req-7e772124-1af6-4033-a6b4-b486df3c101b service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:24.590829 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-a6f379aa-51c0-41c8-b23f-a7f12ac7efca req-7e772124-1af6-4033-a6b4-b486df3c101b service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:24.605510 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-65395bf2-c684-4248-9ffd-e73633286043 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Getting quotas for project 6898e751314d4e94af3fc6df9b465470. Resources: {'cores', 'instances', 'ram'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:31:24.618481 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-65395bf2-c684-4248-9ffd-e73633286043 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Getting quotas for user a53d77fd836e4abda2cb59d5ed6c370e and project 6898e751314d4e94af3fc6df9b465470. Resources: {'cores', 'instances', 'ram'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:31:24.635177 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-a6f379aa-51c0-41c8-b23f-a7f12ac7efca req-7e772124-1af6-4033-a6b4-b486df3c101b service nova] Creating event network-changed:3c89bced-e266-4c30-8918-8d80f7f8660a for instance 10dd91a3-b40e-4ac3-ac2c-63624e87cf93 on hv-cinder-81322 Dec 15 13:31:24.635709 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-a6f379aa-51c0-41c8-b23f-a7f12ac7efca req-7e772124-1af6-4033-a6b4-b486df3c101b service nova] Acquired lock "compute-rpcapi-router" {{(pid=116942) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 15 13:31:24.642018 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-289d1871-ec56-4f1e-9eac-c697773e6a67 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:24.642476 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-289d1871-ec56-4f1e-9eac-c697773e6a67 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:24.648124 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-289d1871-ec56-4f1e-9eac-c697773e6a67 None None] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:24.648707 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-289d1871-ec56-4f1e-9eac-c697773e6a67 None None] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:24.660171 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-65395bf2-c684-4248-9ffd-e73633286043 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Going to run 1 instances... {{(pid=116941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:31:24.664030 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-65395bf2-c684-4248-9ffd-e73633286043 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cfccedbb-7169-47ec-9bae-d4829cba54e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:31:24.692536 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.compute.rpcapi [None req-289d1871-ec56-4f1e-9eac-c697773e6a67 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Dec 15 13:31:24.693821 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-289d1871-ec56-4f1e-9eac-c697773e6a67 None None] Releasing lock "compute-rpcapi-router" {{(pid=116942) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 15 13:31:24.774791 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-65395bf2-c684-4248-9ffd-e73633286043 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.639364 Dec 15 13:31:24.776257 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 35/78] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Dec 15 13:31:21 2021] POST /compute/v2.1/servers => generated 383 bytes in 3645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 13:31:24.781149 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-289d1871-ec56-4f1e-9eac-c697773e6a67 None None] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.748713 Dec 15 13:31:24.782148 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 44/79] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:31:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:31:24.788706 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-eb3416ff-5aa1-4769-ad00-e552a7b42cd5 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:24.789583 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-eb3416ff-5aa1-4769-ad00-e552a7b42cd5 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 10dd91a3-b40e-4ac3-ac2c-63624e87cf93] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:24.791843 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-a94d1ca1-11de-4232-96d4-52979a867ccd tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:24.792608 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-a94d1ca1-11de-4232-96d4-52979a867ccd tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:24.800046 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-eb3416ff-5aa1-4769-ad00-e552a7b42cd5 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:24.803360 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-eb3416ff-5aa1-4769-ad00-e552a7b42cd5 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:24.804872 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a94d1ca1-11de-4232-96d4-52979a867ccd tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:24.805331 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a94d1ca1-11de-4232-96d4-52979a867ccd tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:24.806133 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a94d1ca1-11de-4232-96d4-52979a867ccd tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:24.806572 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a94d1ca1-11de-4232-96d4-52979a867ccd tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:24.807216 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-eb3416ff-5aa1-4769-ad00-e552a7b42cd5 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:24.808537 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-eb3416ff-5aa1-4769-ad00-e552a7b42cd5 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:25.637360 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-a94d1ca1-11de-4232-96d4-52979a867ccd tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:25.665684 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-a94d1ca1-11de-4232-96d4-52979a867ccd tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:25.669534 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-a94d1ca1-11de-4232-96d4-52979a867ccd tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:25.672076 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-a94d1ca1-11de-4232-96d4-52979a867ccd tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1407 microversion: 2.20 time: 0.888551 Dec 15 13:31:25.673114 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 45/80] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:31:24 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1407 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:31:25.688063 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-2bc34ad9-79c7-497a-821c-06fca8930823 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:25.689388 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-2bc34ad9-79c7-497a-821c-06fca8930823 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:25.857982 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-eb3416ff-5aa1-4769-ad00-e552a7b42cd5 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:25.867664 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-eb3416ff-5aa1-4769-ad00-e552a7b42cd5 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93" status: 200 len: 1318 microversion: 2.1 time: 1.089345 Dec 15 13:31:25.868565 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 36/81] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:24 2021] GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93 => generated 1318 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:25.886425 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-cd355ca6-0a8e-4f85-bfdd-6592cd5afa16 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:25.887089 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-cd355ca6-0a8e-4f85-bfdd-6592cd5afa16 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] [instance: c3130b20-b0cc-484a-b6b4-b4719540a6a2] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:25.893860 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cd355ca6-0a8e-4f85-bfdd-6592cd5afa16 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:25.894322 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cd355ca6-0a8e-4f85-bfdd-6592cd5afa16 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:25.895142 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cd355ca6-0a8e-4f85-bfdd-6592cd5afa16 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:25.901373 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cd355ca6-0a8e-4f85-bfdd-6592cd5afa16 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:25.934419 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-2bc34ad9-79c7-497a-821c-06fca8930823 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:25.944815 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-2bc34ad9-79c7-497a-821c-06fca8930823 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a" status: 200 len: 1222 microversion: 2.1 time: 0.270087 Dec 15 13:31:25.945612 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 46/82] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:25 2021] GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a => generated 1222 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:26.126621 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-482e5fc1-75db-4d07-b470-80b0a43ec4a5 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1202813233", "imageRef": "cfccedbb-7169-47ec-9bae-d4829cba54e1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "818413aa-89a4-4338-a133-8010a51bc5a9"}]}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:31:26.187763 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.network.neutron [None req-482e5fc1-75db-4d07-b470-80b0a43ec4a5 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] validate_networks() for [('818413aa-89a4-4338-a133-8010a51bc5a9', None, None, None, None, None)] {{(pid=116942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:31:26.462205 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-cd355ca6-0a8e-4f85-bfdd-6592cd5afa16 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07defc49f2774d9e9c7001504aa647ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6099655f06b473db6eb84adfee54156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:26.470534 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-cd355ca6-0a8e-4f85-bfdd-6592cd5afa16 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] 10.222.0.60 "GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2" status: 200 len: 1314 microversion: 2.1 time: 0.588606 Dec 15 13:31:26.471386 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 37/83] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:25 2021] GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2 => generated 1314 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:26.476545 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-06973263-2d64-4cea-9666-c6570184a8e9 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1815120416", "imageRef": "cfccedbb-7169-47ec-9bae-d4829cba54e1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c615d296-1c4b-42bd-b81b-913328306550"}], "security_groups": [{"name": "tempest-securitygroup--1828775377"}], "key_name": "tempest-keypair-1233220904", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:31:26.755003 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.network.neutron [None req-06973263-2d64-4cea-9666-c6570184a8e9 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] validate_networks() for [('c615d296-1c4b-42bd-b81b-913328306550', None, None, None, None, None)] {{(pid=116941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:31:27.244158 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-482e5fc1-75db-4d07-b470-80b0a43ec4a5 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Flavor limits 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:31:27.245258 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-482e5fc1-75db-4d07-b470-80b0a43ec4a5 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Image limits 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:31:27.245975 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-482e5fc1-75db-4d07-b470-80b0a43ec4a5 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Flavor pref 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:31:27.246575 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-482e5fc1-75db-4d07-b470-80b0a43ec4a5 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Image pref 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:31:27.247043 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-482e5fc1-75db-4d07-b470-80b0a43ec4a5 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:31:27.257353 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-482e5fc1-75db-4d07-b470-80b0a43ec4a5 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:27.257828 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-482e5fc1-75db-4d07-b470-80b0a43ec4a5 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:27.258651 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-482e5fc1-75db-4d07-b470-80b0a43ec4a5 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:27.259128 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-482e5fc1-75db-4d07-b470-80b0a43ec4a5 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:27.277246 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-482e5fc1-75db-4d07-b470-80b0a43ec4a5 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Getting quotas for project 6898e751314d4e94af3fc6df9b465470. Resources: {'cores', 'instances', 'ram'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:31:27.282027 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-482e5fc1-75db-4d07-b470-80b0a43ec4a5 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Getting quotas for user a53d77fd836e4abda2cb59d5ed6c370e and project 6898e751314d4e94af3fc6df9b465470. Resources: {'cores', 'instances', 'ram'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:31:27.292979 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-482e5fc1-75db-4d07-b470-80b0a43ec4a5 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Going to run 1 instances... {{(pid=116942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:31:27.295526 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-482e5fc1-75db-4d07-b470-80b0a43ec4a5 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: d3c2da8c-7e29-48ac-9077-59bffb2c734b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cfccedbb-7169-47ec-9bae-d4829cba54e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:31:27.339484 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-06973263-2d64-4cea-9666-c6570184a8e9 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Flavor limits 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:31:27.339920 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-06973263-2d64-4cea-9666-c6570184a8e9 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Image limits 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:31:27.340363 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-06973263-2d64-4cea-9666-c6570184a8e9 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Flavor pref 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:31:27.340824 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-06973263-2d64-4cea-9666-c6570184a8e9 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Image pref 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:31:27.341239 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-06973263-2d64-4cea-9666-c6570184a8e9 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:31:27.349794 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-482e5fc1-75db-4d07-b470-80b0a43ec4a5 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.236803 Dec 15 13:31:27.351096 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 47/84] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Dec 15 13:31:26 2021] POST /compute/v2.1/servers => generated 383 bytes in 1239 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 13:31:27.356774 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-92343dd4-a54b-4d12-8c52-fa255f99a9b2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:27.357858 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-92343dd4-a54b-4d12-8c52-fa255f99a9b2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:27.362217 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-06973263-2d64-4cea-9666-c6570184a8e9 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:27.362675 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-06973263-2d64-4cea-9666-c6570184a8e9 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:27.363721 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-06973263-2d64-4cea-9666-c6570184a8e9 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:27.364472 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-06973263-2d64-4cea-9666-c6570184a8e9 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:27.365262 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-92343dd4-a54b-4d12-8c52-fa255f99a9b2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:27.365971 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-92343dd4-a54b-4d12-8c52-fa255f99a9b2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:27.367049 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-92343dd4-a54b-4d12-8c52-fa255f99a9b2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:27.367538 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-92343dd4-a54b-4d12-8c52-fa255f99a9b2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:27.411665 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-06973263-2d64-4cea-9666-c6570184a8e9 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Getting quotas for project 4cde9c0e34334ad7a7e79bfeb8963935. Resources: {'cores', 'instances', 'ram'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:31:27.417061 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-06973263-2d64-4cea-9666-c6570184a8e9 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Getting quotas for user e2f51c315df74089bc6873e889cf80d7 and project 4cde9c0e34334ad7a7e79bfeb8963935. Resources: {'cores', 'instances', 'ram'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:31:27.433984 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-06973263-2d64-4cea-9666-c6570184a8e9 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Going to run 1 instances... {{(pid=116941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:31:27.436262 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-06973263-2d64-4cea-9666-c6570184a8e9 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cfccedbb-7169-47ec-9bae-d4829cba54e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:31:27.500183 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-06973263-2d64-4cea-9666-c6570184a8e9 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.027419 Dec 15 13:31:27.500963 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 38/85] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Dec 15 13:31:26 2021] POST /compute/v2.1/servers => generated 402 bytes in 1029 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 13:31:27.505456 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-71865a4c-0503-461a-a4a8-e3c7da828859 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:27.506474 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-71865a4c-0503-461a-a4a8-e3c7da828859 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 10dd91a3-b40e-4ac3-ac2c-63624e87cf93] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:27.513416 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-71865a4c-0503-461a-a4a8-e3c7da828859 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:27.513864 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-71865a4c-0503-461a-a4a8-e3c7da828859 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:27.514811 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-71865a4c-0503-461a-a4a8-e3c7da828859 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:27.515329 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-71865a4c-0503-461a-a4a8-e3c7da828859 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:27.634723 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-92343dd4-a54b-4d12-8c52-fa255f99a9b2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:27.648229 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-92343dd4-a54b-4d12-8c52-fa255f99a9b2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:27.650424 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-92343dd4-a54b-4d12-8c52-fa255f99a9b2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:27.651597 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-92343dd4-a54b-4d12-8c52-fa255f99a9b2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1407 microversion: 2.20 time: 0.299347 Dec 15 13:31:27.653159 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 48/86] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:31:27 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1407 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:31:27.711555 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-554e4d23-0f13-4e1d-8d0c-61ddc7957d82 req-3d3a7b56-1ebe-424c-9961-fe10b163519b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3130b20-b0cc-484a-b6b4-b4719540a6a2", "tag": "5f86201e-ee23-4c92-b757-cb0449191f53"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:31:27.717593 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:31:27.717593 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: warnings.warn(msg) Dec 15 13:31:27.728449 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-71865a4c-0503-461a-a4a8-e3c7da828859 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:27.730442 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-554e4d23-0f13-4e1d-8d0c-61ddc7957d82 req-3d3a7b56-1ebe-424c-9961-fe10b163519b service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:27.731087 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-554e4d23-0f13-4e1d-8d0c-61ddc7957d82 req-3d3a7b56-1ebe-424c-9961-fe10b163519b service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:27.737688 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-71865a4c-0503-461a-a4a8-e3c7da828859 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93" status: 200 len: 1318 microversion: 2.1 time: 0.235317 Dec 15 13:31:27.738637 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 39/87] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:27 2021] GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93 => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:27.763118 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-554e4d23-0f13-4e1d-8d0c-61ddc7957d82 req-3d3a7b56-1ebe-424c-9961-fe10b163519b service nova] Creating event network-changed:5f86201e-ee23-4c92-b757-cb0449191f53 for instance c3130b20-b0cc-484a-b6b4-b4719540a6a2 on hv-cinder-81322 Dec 15 13:31:27.778416 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-554e4d23-0f13-4e1d-8d0c-61ddc7957d82 req-3d3a7b56-1ebe-424c-9961-fe10b163519b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123670 Dec 15 13:31:27.781613 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 49/88] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:31:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:31:27.790885 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-616d8d97-094e-4a35-bf7b-28154eb69c19 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:27.792985 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-616d8d97-094e-4a35-bf7b-28154eb69c19 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: d3c2da8c-7e29-48ac-9077-59bffb2c734b] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:27.877630 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-616d8d97-094e-4a35-bf7b-28154eb69c19 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:27.885717 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-616d8d97-094e-4a35-bf7b-28154eb69c19 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b" status: 200 len: 1222 microversion: 2.1 time: 0.102916 Dec 15 13:31:27.886952 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 50/89] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:27 2021] GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b => generated 1222 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:27.902962 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-bc7f1863-a277-4649-bcde-3ba5d8f98d14 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:27.903794 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-bc7f1863-a277-4649-bcde-3ba5d8f98d14 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] [instance: c3130b20-b0cc-484a-b6b4-b4719540a6a2] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:27.912578 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-bc7f1863-a277-4649-bcde-3ba5d8f98d14 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:27.913318 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-bc7f1863-a277-4649-bcde-3ba5d8f98d14 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:27.914327 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-bc7f1863-a277-4649-bcde-3ba5d8f98d14 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:27.915196 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-bc7f1863-a277-4649-bcde-3ba5d8f98d14 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:28.072685 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-1239761b-8ae6-4b21-8261-acbb86bf5a39 req-5d3060fb-ebfb-492c-8e3e-e04b492876b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00671676-47cb-4266-b9e5-61c7fb120355", "tag": "33030795-e868-427d-8a6a-6d48523668bc"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:31:28.075625 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:31:28.075625 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: warnings.warn(msg) Dec 15 13:31:28.079867 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-bc7f1863-a277-4649-bcde-3ba5d8f98d14 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07defc49f2774d9e9c7001504aa647ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6099655f06b473db6eb84adfee54156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:28.088445 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-1239761b-8ae6-4b21-8261-acbb86bf5a39 req-5d3060fb-ebfb-492c-8e3e-e04b492876b5 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:28.088895 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-1239761b-8ae6-4b21-8261-acbb86bf5a39 req-5d3060fb-ebfb-492c-8e3e-e04b492876b5 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:28.090259 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-bc7f1863-a277-4649-bcde-3ba5d8f98d14 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] 10.222.0.60 "GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2" status: 200 len: 1314 microversion: 2.1 time: 0.202017 Dec 15 13:31:28.090934 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 51/90] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:27 2021] GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:28.104329 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-dd283b29-a564-41b3-8ad7-7f5f3afb9c5a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:28.104950 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-dd283b29-a564-41b3-8ad7-7f5f3afb9c5a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:28.112101 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-dd283b29-a564-41b3-8ad7-7f5f3afb9c5a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:28.112561 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-dd283b29-a564-41b3-8ad7-7f5f3afb9c5a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:28.113363 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-dd283b29-a564-41b3-8ad7-7f5f3afb9c5a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:28.113801 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-dd283b29-a564-41b3-8ad7-7f5f3afb9c5a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:28.116102 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-1239761b-8ae6-4b21-8261-acbb86bf5a39 req-5d3060fb-ebfb-492c-8e3e-e04b492876b5 service nova] Creating event network-changed:33030795-e868-427d-8a6a-6d48523668bc for instance 00671676-47cb-4266-b9e5-61c7fb120355 on hv-cinder-81322 Dec 15 13:31:28.116813 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-1239761b-8ae6-4b21-8261-acbb86bf5a39 req-5d3060fb-ebfb-492c-8e3e-e04b492876b5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116941) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 15 13:31:28.117939 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c5961507-0d94-4488-af7d-34b70277aa71 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:28.118380 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c5961507-0d94-4488-af7d-34b70277aa71 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:28.119216 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c5961507-0d94-4488-af7d-34b70277aa71 None None] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:28.119651 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c5961507-0d94-4488-af7d-34b70277aa71 None None] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:28.128324 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.compute.rpcapi [None req-c5961507-0d94-4488-af7d-34b70277aa71 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Dec 15 13:31:28.129434 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c5961507-0d94-4488-af7d-34b70277aa71 None None] Releasing lock "compute-rpcapi-router" {{(pid=116941) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 15 13:31:28.165506 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-c5961507-0d94-4488-af7d-34b70277aa71 None None] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.425558 Dec 15 13:31:28.166333 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 40/91] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:31:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:31:28.179395 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-dd283b29-a564-41b3-8ad7-7f5f3afb9c5a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:28.186696 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-dd283b29-a564-41b3-8ad7-7f5f3afb9c5a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1242 microversion: 2.1 time: 0.093694 Dec 15 13:31:28.187316 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 52/92] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:28 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1242 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:28.670208 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-a309fd6a-959a-430b-8f9b-9461a7fc93f4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:28.671838 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-a309fd6a-959a-430b-8f9b-9461a7fc93f4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:28.678336 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a309fd6a-959a-430b-8f9b-9461a7fc93f4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:28.682600 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a309fd6a-959a-430b-8f9b-9461a7fc93f4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:28.684817 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a309fd6a-959a-430b-8f9b-9461a7fc93f4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:28.685339 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a309fd6a-959a-430b-8f9b-9461a7fc93f4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:28.755799 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-dc8ca4b4-c27f-40b3-8615-24f5b62b13df tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:28.757302 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-dc8ca4b4-c27f-40b3-8615-24f5b62b13df tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 10dd91a3-b40e-4ac3-ac2c-63624e87cf93] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:28.767704 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-dc8ca4b4-c27f-40b3-8615-24f5b62b13df tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:28.768515 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-dc8ca4b4-c27f-40b3-8615-24f5b62b13df tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:28.770467 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-dc8ca4b4-c27f-40b3-8615-24f5b62b13df tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:28.771157 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-dc8ca4b4-c27f-40b3-8615-24f5b62b13df tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:28.920079 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-a309fd6a-959a-430b-8f9b-9461a7fc93f4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:28.928728 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-a309fd6a-959a-430b-8f9b-9461a7fc93f4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:28.930219 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-a309fd6a-959a-430b-8f9b-9461a7fc93f4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:28.931336 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-a309fd6a-959a-430b-8f9b-9461a7fc93f4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1407 microversion: 2.20 time: 0.265132 Dec 15 13:31:28.931903 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 41/93] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:31:28 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1407 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:31:28.945858 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-59bda4a8-f0ba-41ee-9d3b-470f920908e5 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:28.946470 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-59bda4a8-f0ba-41ee-9d3b-470f920908e5 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: d3c2da8c-7e29-48ac-9077-59bffb2c734b] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:28.959641 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-59bda4a8-f0ba-41ee-9d3b-470f920908e5 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:28.960317 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-59bda4a8-f0ba-41ee-9d3b-470f920908e5 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:28.962909 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-59bda4a8-f0ba-41ee-9d3b-470f920908e5 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:28.963564 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-59bda4a8-f0ba-41ee-9d3b-470f920908e5 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:29.064627 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-59bda4a8-f0ba-41ee-9d3b-470f920908e5 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:29.064925 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-dc8ca4b4-c27f-40b3-8615-24f5b62b13df tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:29.069195 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-59bda4a8-f0ba-41ee-9d3b-470f920908e5 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b" status: 200 len: 1226 microversion: 2.1 time: 0.136270 Dec 15 13:31:29.069971 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 42/94] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:28 2021] GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b => generated 1226 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:29.072742 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-dc8ca4b4-c27f-40b3-8615-24f5b62b13df tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93" status: 200 len: 1318 microversion: 2.1 time: 0.323103 Dec 15 13:31:29.073317 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 53/95] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:28 2021] GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93 => generated 1318 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:31:29.107442 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-b0aab917-3cd7-4278-94e9-07c98e465b0d tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:29.108051 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-b0aab917-3cd7-4278-94e9-07c98e465b0d tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] [instance: c3130b20-b0cc-484a-b6b4-b4719540a6a2] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:29.114605 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b0aab917-3cd7-4278-94e9-07c98e465b0d tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:29.115085 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b0aab917-3cd7-4278-94e9-07c98e465b0d tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:29.115869 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b0aab917-3cd7-4278-94e9-07c98e465b0d tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:29.116461 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b0aab917-3cd7-4278-94e9-07c98e465b0d tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:29.204148 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-2ce390c0-fa7c-4ad9-9d41-ac861c827233 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:29.205926 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-2ce390c0-fa7c-4ad9-9d41-ac861c827233 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:29.212363 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2ce390c0-fa7c-4ad9-9d41-ac861c827233 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:29.212638 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2ce390c0-fa7c-4ad9-9d41-ac861c827233 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:29.213586 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2ce390c0-fa7c-4ad9-9d41-ac861c827233 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:29.214386 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2ce390c0-fa7c-4ad9-9d41-ac861c827233 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:29.287862 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-2ce390c0-fa7c-4ad9-9d41-ac861c827233 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:29.295785 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-b0aab917-3cd7-4278-94e9-07c98e465b0d tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07defc49f2774d9e9c7001504aa647ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6099655f06b473db6eb84adfee54156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:29.302490 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-2ce390c0-fa7c-4ad9-9d41-ac861c827233 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1242 microversion: 2.1 time: 0.102528 Dec 15 13:31:29.316693 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-b0aab917-3cd7-4278-94e9-07c98e465b0d tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] 10.222.0.60 "GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2" status: 200 len: 1314 microversion: 2.1 time: 0.212709 Dec 15 13:31:29.316888 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 54/96] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:29 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1242 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:31:29.318056 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 43/97] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:29 2021] GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:29.949257 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-f9db3561-44d1-4334-817a-511aaf7af3bf tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:29.950226 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-f9db3561-44d1-4334-817a-511aaf7af3bf tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:29.959276 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f9db3561-44d1-4334-817a-511aaf7af3bf tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:29.959735 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f9db3561-44d1-4334-817a-511aaf7af3bf tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:29.960523 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f9db3561-44d1-4334-817a-511aaf7af3bf tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:29.960966 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f9db3561-44d1-4334-817a-511aaf7af3bf tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:30.086711 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-f29082b8-1750-4038-a474-95b8f2f67568 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:30.087970 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-f29082b8-1750-4038-a474-95b8f2f67568 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: d3c2da8c-7e29-48ac-9077-59bffb2c734b] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:30.094586 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f29082b8-1750-4038-a474-95b8f2f67568 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:30.095486 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f29082b8-1750-4038-a474-95b8f2f67568 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:30.096342 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f29082b8-1750-4038-a474-95b8f2f67568 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:30.096931 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f29082b8-1750-4038-a474-95b8f2f67568 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:30.098616 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-f9db3561-44d1-4334-817a-511aaf7af3bf tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:30.107402 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-f9db3561-44d1-4334-817a-511aaf7af3bf tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:30.109270 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-f9db3561-44d1-4334-817a-511aaf7af3bf tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:30.111002 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-f9db3561-44d1-4334-817a-511aaf7af3bf tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1407 microversion: 2.20 time: 0.165137 Dec 15 13:31:30.111953 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 55/98] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:31:29 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:31:30.117157 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-a0a9fbe6-55d6-4a46-8085-8835fe7d26ea tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:30.118195 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-a0a9fbe6-55d6-4a46-8085-8835fe7d26ea tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 10dd91a3-b40e-4ac3-ac2c-63624e87cf93] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:30.125746 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a0a9fbe6-55d6-4a46-8085-8835fe7d26ea tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:30.126449 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a0a9fbe6-55d6-4a46-8085-8835fe7d26ea tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:30.127503 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a0a9fbe6-55d6-4a46-8085-8835fe7d26ea tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:30.128166 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a0a9fbe6-55d6-4a46-8085-8835fe7d26ea tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:30.164928 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-f29082b8-1750-4038-a474-95b8f2f67568 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:30.180642 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-f29082b8-1750-4038-a474-95b8f2f67568 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b" status: 200 len: 1226 microversion: 2.1 time: 0.097931 Dec 15 13:31:30.181872 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 44/99] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:30 2021] GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:30.319169 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-84bd0b5a-405c-4405-9914-8cb71fda170e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:30.320077 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-84bd0b5a-405c-4405-9914-8cb71fda170e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:30.327160 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-84bd0b5a-405c-4405-9914-8cb71fda170e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:30.328015 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-84bd0b5a-405c-4405-9914-8cb71fda170e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:30.329624 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-84bd0b5a-405c-4405-9914-8cb71fda170e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:30.330336 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-84bd0b5a-405c-4405-9914-8cb71fda170e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:30.446132 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-84bd0b5a-405c-4405-9914-8cb71fda170e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:30.456497 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-84bd0b5a-405c-4405-9914-8cb71fda170e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1234 microversion: 2.1 time: 0.140789 Dec 15 13:31:30.459031 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 45/100] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:30 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1234 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:31:30.471809 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-13be977a-86cc-440b-8104-0d49a18585b5 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:30.472451 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-13be977a-86cc-440b-8104-0d49a18585b5 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] [instance: c3130b20-b0cc-484a-b6b4-b4719540a6a2] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:30.485888 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-13be977a-86cc-440b-8104-0d49a18585b5 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:30.488016 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-13be977a-86cc-440b-8104-0d49a18585b5 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:30.489963 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-13be977a-86cc-440b-8104-0d49a18585b5 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:30.493042 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-13be977a-86cc-440b-8104-0d49a18585b5 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:30.762686 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-a0a9fbe6-55d6-4a46-8085-8835fe7d26ea tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:30.770188 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-a0a9fbe6-55d6-4a46-8085-8835fe7d26ea tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93" status: 200 len: 1318 microversion: 2.1 time: 0.656929 Dec 15 13:31:30.773006 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 56/101] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:30 2021] GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93 => generated 1318 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:30.925231 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-13be977a-86cc-440b-8104-0d49a18585b5 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07defc49f2774d9e9c7001504aa647ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6099655f06b473db6eb84adfee54156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:30.933190 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-13be977a-86cc-440b-8104-0d49a18585b5 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] 10.222.0.60 "GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2" status: 200 len: 1314 microversion: 2.1 time: 0.471954 Dec 15 13:31:30.933821 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 46/102] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:30 2021] GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2 => generated 1314 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:31.131912 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-f502c4f8-0b4a-47f2-b4fe-b3b4f8ffaab8 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:31.133245 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-f502c4f8-0b4a-47f2-b4fe-b3b4f8ffaab8 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:31.140030 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f502c4f8-0b4a-47f2-b4fe-b3b4f8ffaab8 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:31.141173 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f502c4f8-0b4a-47f2-b4fe-b3b4f8ffaab8 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:31.142129 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f502c4f8-0b4a-47f2-b4fe-b3b4f8ffaab8 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:31.142711 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f502c4f8-0b4a-47f2-b4fe-b3b4f8ffaab8 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:31.198154 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-22cd9200-a1cd-4c5e-9619-dc9b21eaaee5 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:31.198810 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-22cd9200-a1cd-4c5e-9619-dc9b21eaaee5 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: d3c2da8c-7e29-48ac-9077-59bffb2c734b] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:31.207470 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-22cd9200-a1cd-4c5e-9619-dc9b21eaaee5 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:31.208278 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-22cd9200-a1cd-4c5e-9619-dc9b21eaaee5 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:31.209284 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-22cd9200-a1cd-4c5e-9619-dc9b21eaaee5 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:31.210098 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-22cd9200-a1cd-4c5e-9619-dc9b21eaaee5 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:31.364784 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-22cd9200-a1cd-4c5e-9619-dc9b21eaaee5 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:31.373103 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-22cd9200-a1cd-4c5e-9619-dc9b21eaaee5 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b" status: 200 len: 1218 microversion: 2.1 time: 0.179285 Dec 15 13:31:31.373687 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 47/103] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:31 2021] GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b => generated 1218 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:31:31.475528 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-c4446b7d-256a-473b-a41e-bc1885e3ea28 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:31.476137 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-c4446b7d-256a-473b-a41e-bc1885e3ea28 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:31.481907 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c4446b7d-256a-473b-a41e-bc1885e3ea28 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:31.482355 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c4446b7d-256a-473b-a41e-bc1885e3ea28 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:31.483168 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c4446b7d-256a-473b-a41e-bc1885e3ea28 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:31.483773 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c4446b7d-256a-473b-a41e-bc1885e3ea28 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:31.676277 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-c4446b7d-256a-473b-a41e-bc1885e3ea28 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:31.684578 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-c4446b7d-256a-473b-a41e-bc1885e3ea28 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1290 microversion: 2.1 time: 0.212632 Dec 15 13:31:31.697348 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 48/104] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:31 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1290 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:31:31.729357 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-f502c4f8-0b4a-47f2-b4fe-b3b4f8ffaab8 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:31.741968 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-f502c4f8-0b4a-47f2-b4fe-b3b4f8ffaab8 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:31.743769 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-f502c4f8-0b4a-47f2-b4fe-b3b4f8ffaab8 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:31.746453 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-f502c4f8-0b4a-47f2-b4fe-b3b4f8ffaab8 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1407 microversion: 2.20 time: 0.618889 Dec 15 13:31:31.747562 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 57/105] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:31:31 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1407 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:31:31.791428 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-16d8eeeb-aa31-42a2-8cdc-0f3ba9f9472a tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:31.793390 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-16d8eeeb-aa31-42a2-8cdc-0f3ba9f9472a tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 10dd91a3-b40e-4ac3-ac2c-63624e87cf93] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:31.800530 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-16d8eeeb-aa31-42a2-8cdc-0f3ba9f9472a tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:31.801729 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-16d8eeeb-aa31-42a2-8cdc-0f3ba9f9472a tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:31.810301 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-16d8eeeb-aa31-42a2-8cdc-0f3ba9f9472a tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:31.810760 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-16d8eeeb-aa31-42a2-8cdc-0f3ba9f9472a tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:31.951341 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-b712888f-7613-493a-9467-978245b55bcc tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:31.951966 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-b712888f-7613-493a-9467-978245b55bcc tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] [instance: c3130b20-b0cc-484a-b6b4-b4719540a6a2] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:31.966720 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b712888f-7613-493a-9467-978245b55bcc tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:31.967158 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b712888f-7613-493a-9467-978245b55bcc tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:31.967961 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b712888f-7613-493a-9467-978245b55bcc tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:31.968408 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b712888f-7613-493a-9467-978245b55bcc tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:32.207145 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-b712888f-7613-493a-9467-978245b55bcc tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07defc49f2774d9e9c7001504aa647ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6099655f06b473db6eb84adfee54156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:32.214647 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-b712888f-7613-493a-9467-978245b55bcc tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] 10.222.0.60 "GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2" status: 200 len: 1314 microversion: 2.1 time: 0.269125 Dec 15 13:31:32.216845 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 58/106] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:31 2021] GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2 => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:31:32.224193 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-16d8eeeb-aa31-42a2-8cdc-0f3ba9f9472a tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:32.233993 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-16d8eeeb-aa31-42a2-8cdc-0f3ba9f9472a tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93" status: 200 len: 1318 microversion: 2.1 time: 0.447004 Dec 15 13:31:32.235061 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 49/107] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:31 2021] GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93 => generated 1318 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:32.395217 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-a5915e1c-480b-4fc5-8c24-23d0d6549f8a tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:32.396632 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-a5915e1c-480b-4fc5-8c24-23d0d6549f8a tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: d3c2da8c-7e29-48ac-9077-59bffb2c734b] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:32.404232 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a5915e1c-480b-4fc5-8c24-23d0d6549f8a tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:32.405006 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a5915e1c-480b-4fc5-8c24-23d0d6549f8a tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:32.405988 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a5915e1c-480b-4fc5-8c24-23d0d6549f8a tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:32.406798 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a5915e1c-480b-4fc5-8c24-23d0d6549f8a tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:32.509784 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-a5915e1c-480b-4fc5-8c24-23d0d6549f8a tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:32.519072 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-a5915e1c-480b-4fc5-8c24-23d0d6549f8a tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b" status: 200 len: 1274 microversion: 2.1 time: 0.131704 Dec 15 13:31:32.520006 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 59/108] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:32 2021] GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b => generated 1274 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:32.701737 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-9feba01a-9328-4741-bc86-4ca45a952c15 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:32.702318 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-9feba01a-9328-4741-bc86-4ca45a952c15 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:32.708252 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9feba01a-9328-4741-bc86-4ca45a952c15 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:32.708719 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9feba01a-9328-4741-bc86-4ca45a952c15 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:32.709610 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9feba01a-9328-4741-bc86-4ca45a952c15 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:32.710128 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9feba01a-9328-4741-bc86-4ca45a952c15 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:32.765319 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-df2321bc-770f-426f-8858-d7f018af60fc tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:32.766077 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-df2321bc-770f-426f-8858-d7f018af60fc tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:32.773020 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-df2321bc-770f-426f-8858-d7f018af60fc tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:32.773479 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-df2321bc-770f-426f-8858-d7f018af60fc tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:32.774335 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-df2321bc-770f-426f-8858-d7f018af60fc tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:32.774817 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-df2321bc-770f-426f-8858-d7f018af60fc tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:32.777378 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-9feba01a-9328-4741-bc86-4ca45a952c15 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:32.785257 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-9feba01a-9328-4741-bc86-4ca45a952c15 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1296 microversion: 2.1 time: 0.087414 Dec 15 13:31:32.785843 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 50/109] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:32 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1296 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:32.914594 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-df2321bc-770f-426f-8858-d7f018af60fc tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:32.923616 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-df2321bc-770f-426f-8858-d7f018af60fc tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:32.925136 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-df2321bc-770f-426f-8858-d7f018af60fc tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:32.926477 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-df2321bc-770f-426f-8858-d7f018af60fc tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1407 microversion: 2.20 time: 0.165348 Dec 15 13:31:32.927084 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 60/110] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:31:32 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:31:33.233349 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-d496de39-e9d3-43f1-87cf-b6e384d36c6c tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:33.233959 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-d496de39-e9d3-43f1-87cf-b6e384d36c6c tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] [instance: c3130b20-b0cc-484a-b6b4-b4719540a6a2] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:33.240451 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d496de39-e9d3-43f1-87cf-b6e384d36c6c tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:33.240910 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d496de39-e9d3-43f1-87cf-b6e384d36c6c tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:33.241706 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d496de39-e9d3-43f1-87cf-b6e384d36c6c tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:33.242148 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d496de39-e9d3-43f1-87cf-b6e384d36c6c tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:33.252456 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ffc451c2-85a3-4bf0-8846-edc6e61c0aa1 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:33.253055 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ffc451c2-85a3-4bf0-8846-edc6e61c0aa1 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 10dd91a3-b40e-4ac3-ac2c-63624e87cf93] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:33.259481 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ffc451c2-85a3-4bf0-8846-edc6e61c0aa1 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:33.259858 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ffc451c2-85a3-4bf0-8846-edc6e61c0aa1 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:33.260645 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ffc451c2-85a3-4bf0-8846-edc6e61c0aa1 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:33.261188 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ffc451c2-85a3-4bf0-8846-edc6e61c0aa1 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:33.464914 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-d496de39-e9d3-43f1-87cf-b6e384d36c6c tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07defc49f2774d9e9c7001504aa647ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6099655f06b473db6eb84adfee54156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:33.475615 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-d496de39-e9d3-43f1-87cf-b6e384d36c6c tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] 10.222.0.60 "GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2" status: 200 len: 1314 microversion: 2.1 time: 0.243740 Dec 15 13:31:33.479157 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 51/111] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:33 2021] GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2 => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:33.493341 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-ffc451c2-85a3-4bf0-8846-edc6e61c0aa1 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:33.503916 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ffc451c2-85a3-4bf0-8846-edc6e61c0aa1 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93" status: 200 len: 1318 microversion: 2.1 time: 0.254909 Dec 15 13:31:33.514426 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 61/112] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:33 2021] GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93 => generated 1318 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:31:33.536978 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-6c95201c-b1a6-4b27-8342-508f1e137b48 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:33.537743 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-6c95201c-b1a6-4b27-8342-508f1e137b48 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: d3c2da8c-7e29-48ac-9077-59bffb2c734b] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:33.546761 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6c95201c-b1a6-4b27-8342-508f1e137b48 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:33.547583 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6c95201c-b1a6-4b27-8342-508f1e137b48 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:33.550175 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6c95201c-b1a6-4b27-8342-508f1e137b48 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:33.551290 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6c95201c-b1a6-4b27-8342-508f1e137b48 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:33.643929 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-6c95201c-b1a6-4b27-8342-508f1e137b48 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:33.651405 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-6c95201c-b1a6-4b27-8342-508f1e137b48 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b" status: 200 len: 1280 microversion: 2.1 time: 0.118669 Dec 15 13:31:33.651988 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 52/113] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:33 2021] GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b => generated 1280 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:33.801610 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-8ebc4448-e016-4f52-ad2f-cbdcea3c3578 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:33.801762 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-8ebc4448-e016-4f52-ad2f-cbdcea3c3578 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:33.811735 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8ebc4448-e016-4f52-ad2f-cbdcea3c3578 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:33.812204 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8ebc4448-e016-4f52-ad2f-cbdcea3c3578 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:33.815233 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8ebc4448-e016-4f52-ad2f-cbdcea3c3578 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:33.817993 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8ebc4448-e016-4f52-ad2f-cbdcea3c3578 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:33.944458 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-8d64d9fd-e33a-47e2-b13b-b15b4c194756 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:33.944666 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-8d64d9fd-e33a-47e2-b13b-b15b4c194756 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:33.952785 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8d64d9fd-e33a-47e2-b13b-b15b4c194756 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:33.958276 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8d64d9fd-e33a-47e2-b13b-b15b4c194756 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:33.959171 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8d64d9fd-e33a-47e2-b13b-b15b4c194756 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:33.959598 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8d64d9fd-e33a-47e2-b13b-b15b4c194756 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:33.961163 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-8ebc4448-e016-4f52-ad2f-cbdcea3c3578 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:33.972588 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-8ebc4448-e016-4f52-ad2f-cbdcea3c3578 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1296 microversion: 2.1 time: 0.174981 Dec 15 13:31:33.977937 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 62/114] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:33 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1296 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:34.229041 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-8d64d9fd-e33a-47e2-b13b-b15b4c194756 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:34.239492 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-8d64d9fd-e33a-47e2-b13b-b15b4c194756 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:34.241241 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-8d64d9fd-e33a-47e2-b13b-b15b4c194756 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:34.242351 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-8d64d9fd-e33a-47e2-b13b-b15b4c194756 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1407 microversion: 2.20 time: 0.302001 Dec 15 13:31:34.251284 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 53/115] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:31:33 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1407 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:31:34.494037 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-c1ccb71f-e7cd-436c-a7eb-a771a92a1bb7 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:34.494677 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-c1ccb71f-e7cd-436c-a7eb-a771a92a1bb7 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] [instance: c3130b20-b0cc-484a-b6b4-b4719540a6a2] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:34.504555 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c1ccb71f-e7cd-436c-a7eb-a771a92a1bb7 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:34.505014 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c1ccb71f-e7cd-436c-a7eb-a771a92a1bb7 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:34.507901 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c1ccb71f-e7cd-436c-a7eb-a771a92a1bb7 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:34.510014 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c1ccb71f-e7cd-436c-a7eb-a771a92a1bb7 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:34.521179 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-f58ebddf-3c47-4156-beb2-b840cadc3f38 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:34.522112 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-f58ebddf-3c47-4156-beb2-b840cadc3f38 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 10dd91a3-b40e-4ac3-ac2c-63624e87cf93] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:34.532948 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f58ebddf-3c47-4156-beb2-b840cadc3f38 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:34.534656 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f58ebddf-3c47-4156-beb2-b840cadc3f38 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:34.536180 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f58ebddf-3c47-4156-beb2-b840cadc3f38 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:34.538706 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f58ebddf-3c47-4156-beb2-b840cadc3f38 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:34.991172 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-f58ebddf-3c47-4156-beb2-b840cadc3f38 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:35.004046 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-f58ebddf-3c47-4156-beb2-b840cadc3f38 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93" status: 200 len: 1318 microversion: 2.1 time: 0.485805 Dec 15 13:31:35.018227 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 54/116] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:34 2021] GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93 => generated 1318 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:35.029379 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-b83577ab-9a65-4409-afec-a1b070a28cbc tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:35.030131 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-b83577ab-9a65-4409-afec-a1b070a28cbc tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: d3c2da8c-7e29-48ac-9077-59bffb2c734b] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:35.045061 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b83577ab-9a65-4409-afec-a1b070a28cbc tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:35.045461 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b83577ab-9a65-4409-afec-a1b070a28cbc tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:35.049267 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b83577ab-9a65-4409-afec-a1b070a28cbc tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:35.049897 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b83577ab-9a65-4409-afec-a1b070a28cbc tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:35.212711 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-c1ccb71f-e7cd-436c-a7eb-a771a92a1bb7 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07defc49f2774d9e9c7001504aa647ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6099655f06b473db6eb84adfee54156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:35.239483 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-c1ccb71f-e7cd-436c-a7eb-a771a92a1bb7 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] 10.222.0.60 "GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2" status: 200 len: 1314 microversion: 2.1 time: 0.749641 Dec 15 13:31:35.245592 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 63/117] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:34 2021] GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2 => generated 1314 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:35.247897 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-8e0463b8-f1c9-47f2-b90c-1934ee08e058 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:35.248560 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-8e0463b8-f1c9-47f2-b90c-1934ee08e058 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:35.256251 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8e0463b8-f1c9-47f2-b90c-1934ee08e058 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:35.256726 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8e0463b8-f1c9-47f2-b90c-1934ee08e058 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:35.257529 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8e0463b8-f1c9-47f2-b90c-1934ee08e058 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:35.257971 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8e0463b8-f1c9-47f2-b90c-1934ee08e058 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:35.697188 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-b83577ab-9a65-4409-afec-a1b070a28cbc tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:35.715072 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-b83577ab-9a65-4409-afec-a1b070a28cbc tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b" status: 200 len: 1322 microversion: 2.1 time: 0.695467 Dec 15 13:31:35.716553 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 55/118] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:35 2021] GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b => generated 1322 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:35.726877 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-648bd313-09ff-4be6-93e7-f2d13efa751c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:35.727565 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-648bd313-09ff-4be6-93e7-f2d13efa751c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:35.738117 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-648bd313-09ff-4be6-93e7-f2d13efa751c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:35.738632 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-648bd313-09ff-4be6-93e7-f2d13efa751c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:35.739533 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-648bd313-09ff-4be6-93e7-f2d13efa751c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:35.739978 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-648bd313-09ff-4be6-93e7-f2d13efa751c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:35.774192 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-8e0463b8-f1c9-47f2-b90c-1934ee08e058 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:35.782241 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-8e0463b8-f1c9-47f2-b90c-1934ee08e058 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1364 microversion: 2.1 time: 0.538026 Dec 15 13:31:35.782826 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 64/119] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:35 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1364 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:35.955155 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-648bd313-09ff-4be6-93e7-f2d13efa751c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:35.964899 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-648bd313-09ff-4be6-93e7-f2d13efa751c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:35.966542 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-648bd313-09ff-4be6-93e7-f2d13efa751c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:35.967941 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-648bd313-09ff-4be6-93e7-f2d13efa751c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1407 microversion: 2.20 time: 0.250342 Dec 15 13:31:35.979921 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 56/120] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:31:35 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1407 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:31:36.036076 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ccf460a0-3896-4c27-ba32-34a46279e03d tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:36.037410 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ccf460a0-3896-4c27-ba32-34a46279e03d tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 10dd91a3-b40e-4ac3-ac2c-63624e87cf93] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:36.051130 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ccf460a0-3896-4c27-ba32-34a46279e03d tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:36.051615 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ccf460a0-3896-4c27-ba32-34a46279e03d tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:36.055675 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ccf460a0-3896-4c27-ba32-34a46279e03d tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:36.056159 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ccf460a0-3896-4c27-ba32-34a46279e03d tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:36.258313 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-25cbd3a1-e85c-4a86-b17b-653aa2761e09 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:36.259040 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-25cbd3a1-e85c-4a86-b17b-653aa2761e09 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] [instance: c3130b20-b0cc-484a-b6b4-b4719540a6a2] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:36.265988 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-25cbd3a1-e85c-4a86-b17b-653aa2761e09 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:36.266441 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-25cbd3a1-e85c-4a86-b17b-653aa2761e09 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:36.267259 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-25cbd3a1-e85c-4a86-b17b-653aa2761e09 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:36.268075 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-25cbd3a1-e85c-4a86-b17b-653aa2761e09 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:36.385274 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-ccf460a0-3896-4c27-ba32-34a46279e03d tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:36.394630 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ccf460a0-3896-4c27-ba32-34a46279e03d tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93" status: 200 len: 1318 microversion: 2.1 time: 0.363123 Dec 15 13:31:36.399443 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 65/121] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:36 2021] GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93 => generated 1318 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:36.419014 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-77d7f2e7-05f7-414f-aa41-10957adc9039 req-8925a2c1-de0e-4ee6-b4e8-9d8160de1a1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eab2a5ce-9a56-4120-ae3c-ddfb844aa30a", "tag": "a1a46728-afb1-43b7-8e1d-b0e5ecdf5e2d"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:31:36.430395 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:31:36.430395 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: warnings.warn(msg) Dec 15 13:31:36.473912 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-77d7f2e7-05f7-414f-aa41-10957adc9039 req-8925a2c1-de0e-4ee6-b4e8-9d8160de1a1a service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:36.474418 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-77d7f2e7-05f7-414f-aa41-10957adc9039 req-8925a2c1-de0e-4ee6-b4e8-9d8160de1a1a service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:36.500728 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-77d7f2e7-05f7-414f-aa41-10957adc9039 req-8925a2c1-de0e-4ee6-b4e8-9d8160de1a1a service nova] Creating event network-changed:a1a46728-afb1-43b7-8e1d-b0e5ecdf5e2d for instance eab2a5ce-9a56-4120-ae3c-ddfb844aa30a on hv-cinder-81322 Dec 15 13:31:36.513452 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-77d7f2e7-05f7-414f-aa41-10957adc9039 req-8925a2c1-de0e-4ee6-b4e8-9d8160de1a1a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112411 Dec 15 13:31:36.518239 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 66/122] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:31:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:31:36.690890 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-25cbd3a1-e85c-4a86-b17b-653aa2761e09 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07defc49f2774d9e9c7001504aa647ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6099655f06b473db6eb84adfee54156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:36.696548 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-25cbd3a1-e85c-4a86-b17b-653aa2761e09 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] 10.222.0.60 "GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2" status: 200 len: 1314 microversion: 2.1 time: 0.441873 Dec 15 13:31:36.697415 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 57/123] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:36 2021] GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2 => generated 1314 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:31:36.733533 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-0f0052a2-4754-4688-acf4-81850e359971 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:36.734720 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-0f0052a2-4754-4688-acf4-81850e359971 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: d3c2da8c-7e29-48ac-9077-59bffb2c734b] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:36.740942 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0f0052a2-4754-4688-acf4-81850e359971 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:36.741578 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0f0052a2-4754-4688-acf4-81850e359971 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:36.742645 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0f0052a2-4754-4688-acf4-81850e359971 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:36.743329 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0f0052a2-4754-4688-acf4-81850e359971 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:36.800891 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-0ab848f9-11de-4aa7-b249-818c16d29622 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:36.801822 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-0ab848f9-11de-4aa7-b249-818c16d29622 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:36.809591 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0ab848f9-11de-4aa7-b249-818c16d29622 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:36.810106 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0ab848f9-11de-4aa7-b249-818c16d29622 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:36.811009 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0ab848f9-11de-4aa7-b249-818c16d29622 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:36.811655 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0ab848f9-11de-4aa7-b249-818c16d29622 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:37.377920 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-0f0052a2-4754-4688-acf4-81850e359971 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:37.384492 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-0ab848f9-11de-4aa7-b249-818c16d29622 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:37.394711 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-0ab848f9-11de-4aa7-b249-818c16d29622 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1364 microversion: 2.1 time: 0.598234 Dec 15 13:31:37.395665 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 58/124] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:36 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1364 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:37.404707 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-0f0052a2-4754-4688-acf4-81850e359971 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b" status: 200 len: 1322 microversion: 2.1 time: 0.672397 Dec 15 13:31:37.409844 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-19ce3d78-60cb-42ef-abef-610c8d8cb91f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:37.410903 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-19ce3d78-60cb-42ef-abef-610c8d8cb91f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:37.416445 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 67/125] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:36 2021] GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b => generated 1322 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:37.420433 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-19ce3d78-60cb-42ef-abef-610c8d8cb91f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:37.421427 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-19ce3d78-60cb-42ef-abef-610c8d8cb91f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:37.423186 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-846a7a42-f631-4da5-92a3-a803902629d9 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:37.424216 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-846a7a42-f631-4da5-92a3-a803902629d9 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 10dd91a3-b40e-4ac3-ac2c-63624e87cf93] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:37.424558 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-19ce3d78-60cb-42ef-abef-610c8d8cb91f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:37.427010 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-19ce3d78-60cb-42ef-abef-610c8d8cb91f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:37.431298 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-846a7a42-f631-4da5-92a3-a803902629d9 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:37.431967 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-846a7a42-f631-4da5-92a3-a803902629d9 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:37.432905 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-846a7a42-f631-4da5-92a3-a803902629d9 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:37.433619 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-846a7a42-f631-4da5-92a3-a803902629d9 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:37.855801 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-846a7a42-f631-4da5-92a3-a803902629d9 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:37.865044 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-19ce3d78-60cb-42ef-abef-610c8d8cb91f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:37.873075 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-19ce3d78-60cb-42ef-abef-610c8d8cb91f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:37.876284 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-19ce3d78-60cb-42ef-abef-610c8d8cb91f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:37.880135 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-19ce3d78-60cb-42ef-abef-610c8d8cb91f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1407 microversion: 2.20 time: 0.483291 Dec 15 13:31:37.881927 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-846a7a42-f631-4da5-92a3-a803902629d9 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93" status: 200 len: 1318 microversion: 2.1 time: 0.462238 Dec 15 13:31:37.882746 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 59/126] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:31:37 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1407 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:31:37.890788 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-1c044188-3869-4fa6-8650-7a29a35f9368 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:37.894767 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 68/127] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:37 2021] GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93 => generated 1318 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:37.899883 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-1c044188-3869-4fa6-8650-7a29a35f9368 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] [instance: c3130b20-b0cc-484a-b6b4-b4719540a6a2] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:37.917438 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1c044188-3869-4fa6-8650-7a29a35f9368 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:37.918077 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1c044188-3869-4fa6-8650-7a29a35f9368 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:37.920370 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1c044188-3869-4fa6-8650-7a29a35f9368 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:37.922511 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1c044188-3869-4fa6-8650-7a29a35f9368 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:38.330714 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-1c044188-3869-4fa6-8650-7a29a35f9368 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07defc49f2774d9e9c7001504aa647ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6099655f06b473db6eb84adfee54156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:38.346947 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-1c044188-3869-4fa6-8650-7a29a35f9368 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] 10.222.0.60 "GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2" status: 200 len: 1314 microversion: 2.1 time: 0.462797 Dec 15 13:31:38.359857 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 60/128] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:37 2021] GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2 => generated 1314 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:38.414018 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-48a3af51-6324-4efb-8a36-c856d5823838 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:38.414636 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-48a3af51-6324-4efb-8a36-c856d5823838 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:38.433729 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-48a3af51-6324-4efb-8a36-c856d5823838 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:38.435446 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-48a3af51-6324-4efb-8a36-c856d5823838 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:38.436296 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-48a3af51-6324-4efb-8a36-c856d5823838 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:38.436775 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-48a3af51-6324-4efb-8a36-c856d5823838 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:38.487610 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-4c2c279c-c8fc-43db-a1c4-bf8d5a0b6869 req-3d40ef98-aeba-4e24-9acd-4d3129c267e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00671676-47cb-4266-b9e5-61c7fb120355", "name": "network-vif-plugged", "status": "completed", "tag": "33030795-e868-427d-8a6a-6d48523668bc"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:31:38.489134 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:31:38.489134 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: warnings.warn(msg) Dec 15 13:31:38.533747 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-4c2c279c-c8fc-43db-a1c4-bf8d5a0b6869 req-3d40ef98-aeba-4e24-9acd-4d3129c267e8 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:38.534376 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-4c2c279c-c8fc-43db-a1c4-bf8d5a0b6869 req-3d40ef98-aeba-4e24-9acd-4d3129c267e8 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:38.552234 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-4c2c279c-c8fc-43db-a1c4-bf8d5a0b6869 req-3d40ef98-aeba-4e24-9acd-4d3129c267e8 service nova] Creating event network-vif-plugged:33030795-e868-427d-8a6a-6d48523668bc for instance 00671676-47cb-4266-b9e5-61c7fb120355 on hv-cinder-81322 Dec 15 13:31:38.565451 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-4c2c279c-c8fc-43db-a1c4-bf8d5a0b6869 req-3d40ef98-aeba-4e24-9acd-4d3129c267e8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.520547 Dec 15 13:31:38.566057 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 69/129] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:31:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:31:38.589999 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-8634d9c9-7700-41f0-8d3b-5e02d288dbab tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:38.592349 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-8634d9c9-7700-41f0-8d3b-5e02d288dbab tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: d3c2da8c-7e29-48ac-9077-59bffb2c734b] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:38.605066 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8634d9c9-7700-41f0-8d3b-5e02d288dbab tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:38.605527 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8634d9c9-7700-41f0-8d3b-5e02d288dbab tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:38.606333 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8634d9c9-7700-41f0-8d3b-5e02d288dbab tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:38.606962 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8634d9c9-7700-41f0-8d3b-5e02d288dbab tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:38.930085 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-48a3af51-6324-4efb-8a36-c856d5823838 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:38.938023 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-48a3af51-6324-4efb-8a36-c856d5823838 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1364 microversion: 2.1 time: 0.529826 Dec 15 13:31:38.948261 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 61/130] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:38 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1364 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:31:38.954343 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-b7db8d78-21c8-40b2-84ca-134756413c21 req-a7f08982-7bae-48f9-b7e7-ddd466308b73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef0157ed-5d02-45a9-9160-55cc033a16ec", "tag": "745293fa-0314-47a0-bb77-7fceb3a9fc17"}, {"name": "network-changed", "server_uuid": "d3c2da8c-7e29-48ac-9077-59bffb2c734b", "tag": "1f6d7b53-85b8-40d2-b216-fed7cc5d479c"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:31:38.956526 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:31:38.956526 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: warnings.warn(msg) Dec 15 13:31:38.966640 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-b7db8d78-21c8-40b2-84ca-134756413c21 req-a7f08982-7bae-48f9-b7e7-ddd466308b73 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:38.967410 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-b7db8d78-21c8-40b2-84ca-134756413c21 req-a7f08982-7bae-48f9-b7e7-ddd466308b73 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:38.989802 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-b7db8d78-21c8-40b2-84ca-134756413c21 req-a7f08982-7bae-48f9-b7e7-ddd466308b73 service nova] Creating event network-changed:745293fa-0314-47a0-bb77-7fceb3a9fc17 for instance ef0157ed-5d02-45a9-9160-55cc033a16ec on hv-cinder-81322 Dec 15 13:31:38.991265 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-b7db8d78-21c8-40b2-84ca-134756413c21 req-a7f08982-7bae-48f9-b7e7-ddd466308b73 service nova] Creating event network-changed:1f6d7b53-85b8-40d2-b216-fed7cc5d479c for instance d3c2da8c-7e29-48ac-9077-59bffb2c734b on hv-cinder-81322 Dec 15 13:31:38.998007 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-b7db8d78-21c8-40b2-84ca-134756413c21 req-a7f08982-7bae-48f9-b7e7-ddd466308b73 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.047949 Dec 15 13:31:38.999118 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 62/131] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:31:38 2021] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:31:39.004948 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-dcb9ea82-ee16-441d-a969-df214fb1487d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:39.006043 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-dcb9ea82-ee16-441d-a969-df214fb1487d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:39.012607 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-dcb9ea82-ee16-441d-a969-df214fb1487d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:39.013351 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-dcb9ea82-ee16-441d-a969-df214fb1487d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:39.014370 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-dcb9ea82-ee16-441d-a969-df214fb1487d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:39.015079 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-dcb9ea82-ee16-441d-a969-df214fb1487d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:39.027069 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-8634d9c9-7700-41f0-8d3b-5e02d288dbab tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:39.038979 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-8634d9c9-7700-41f0-8d3b-5e02d288dbab tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b" status: 200 len: 1322 microversion: 2.1 time: 0.465677 Dec 15 13:31:39.040112 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 70/132] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:38 2021] GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b => generated 1322 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:39.049108 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-06327e02-a1a7-4911-86f3-951f07cc5821 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:39.049980 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-06327e02-a1a7-4911-86f3-951f07cc5821 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 10dd91a3-b40e-4ac3-ac2c-63624e87cf93] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:39.057564 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-06327e02-a1a7-4911-86f3-951f07cc5821 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:39.058584 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-06327e02-a1a7-4911-86f3-951f07cc5821 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:39.060297 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-06327e02-a1a7-4911-86f3-951f07cc5821 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:39.065101 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-06327e02-a1a7-4911-86f3-951f07cc5821 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:39.410991 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-dcb9ea82-ee16-441d-a969-df214fb1487d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:39.419547 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-dcb9ea82-ee16-441d-a969-df214fb1487d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:39.421819 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-dcb9ea82-ee16-441d-a969-df214fb1487d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:39.422962 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-dcb9ea82-ee16-441d-a969-df214fb1487d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1407 microversion: 2.20 time: 0.422676 Dec 15 13:31:39.423523 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 63/133] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:31:38 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1407 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:31:39.437071 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-4fcb8a1d-bc75-4491-8051-0d2d7943af07 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:39.437712 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-4fcb8a1d-bc75-4491-8051-0d2d7943af07 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] [instance: c3130b20-b0cc-484a-b6b4-b4719540a6a2] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:39.444022 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4fcb8a1d-bc75-4491-8051-0d2d7943af07 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:39.444467 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4fcb8a1d-bc75-4491-8051-0d2d7943af07 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:39.445247 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4fcb8a1d-bc75-4491-8051-0d2d7943af07 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:39.446042 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4fcb8a1d-bc75-4491-8051-0d2d7943af07 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:39.449786 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-06327e02-a1a7-4911-86f3-951f07cc5821 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:39.464984 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-06327e02-a1a7-4911-86f3-951f07cc5821 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93" status: 200 len: 1318 microversion: 2.1 time: 0.422775 Dec 15 13:31:39.466225 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 71/134] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:39 2021] GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93 => generated 1318 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:39.858155 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-4fcb8a1d-bc75-4491-8051-0d2d7943af07 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07defc49f2774d9e9c7001504aa647ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6099655f06b473db6eb84adfee54156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:39.867446 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-4fcb8a1d-bc75-4491-8051-0d2d7943af07 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] 10.222.0.60 "GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2" status: 200 len: 1314 microversion: 2.1 time: 0.441878 Dec 15 13:31:39.868245 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 64/135] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:39 2021] GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2 => generated 1314 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:39.956916 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-1ff1cc72-b311-4b1f-9a46-e46688f75b06 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:39.958388 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-1ff1cc72-b311-4b1f-9a46-e46688f75b06 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:39.965380 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1ff1cc72-b311-4b1f-9a46-e46688f75b06 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:39.966115 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1ff1cc72-b311-4b1f-9a46-e46688f75b06 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:39.967169 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1ff1cc72-b311-4b1f-9a46-e46688f75b06 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:39.967824 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1ff1cc72-b311-4b1f-9a46-e46688f75b06 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:40.056724 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-3c24c7d5-4bf7-467a-a3af-1b5d35a7983b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:40.057336 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-3c24c7d5-4bf7-467a-a3af-1b5d35a7983b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: d3c2da8c-7e29-48ac-9077-59bffb2c734b] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:40.074357 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3c24c7d5-4bf7-467a-a3af-1b5d35a7983b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:40.074807 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3c24c7d5-4bf7-467a-a3af-1b5d35a7983b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:40.076354 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3c24c7d5-4bf7-467a-a3af-1b5d35a7983b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:40.076354 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3c24c7d5-4bf7-467a-a3af-1b5d35a7983b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:40.265805 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-1ff1cc72-b311-4b1f-9a46-e46688f75b06 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:40.281039 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-1ff1cc72-b311-4b1f-9a46-e46688f75b06 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1364 microversion: 2.1 time: 0.328751 Dec 15 13:31:40.282062 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 72/136] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:39 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1364 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:40.354544 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-3c24c7d5-4bf7-467a-a3af-1b5d35a7983b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:40.363819 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-3c24c7d5-4bf7-467a-a3af-1b5d35a7983b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b" status: 200 len: 1322 microversion: 2.1 time: 0.310608 Dec 15 13:31:40.364767 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 65/137] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:40 2021] GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b => generated 1322 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:31:40.442051 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-c113943d-ab96-4683-ae02-cbd62d45098a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:40.442663 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-c113943d-ab96-4683-ae02-cbd62d45098a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:40.449072 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c113943d-ab96-4683-ae02-cbd62d45098a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:40.449535 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c113943d-ab96-4683-ae02-cbd62d45098a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:40.450565 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c113943d-ab96-4683-ae02-cbd62d45098a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:40.451291 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c113943d-ab96-4683-ae02-cbd62d45098a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:40.485220 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-6944a617-80ce-4c7d-921f-09d542e6c7ab tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:40.485437 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-6944a617-80ce-4c7d-921f-09d542e6c7ab tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 10dd91a3-b40e-4ac3-ac2c-63624e87cf93] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:40.498921 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6944a617-80ce-4c7d-921f-09d542e6c7ab tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:40.499379 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6944a617-80ce-4c7d-921f-09d542e6c7ab tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:40.502399 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6944a617-80ce-4c7d-921f-09d542e6c7ab tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:40.502860 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6944a617-80ce-4c7d-921f-09d542e6c7ab tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:40.686775 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-c113943d-ab96-4683-ae02-cbd62d45098a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:40.695731 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-c113943d-ab96-4683-ae02-cbd62d45098a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:40.697464 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-c113943d-ab96-4683-ae02-cbd62d45098a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:40.698772 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-c113943d-ab96-4683-ae02-cbd62d45098a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1407 microversion: 2.20 time: 0.261356 Dec 15 13:31:40.699879 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 73/138] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:31:40 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1407 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:31:40.705081 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-655ca3e9-2447-449a-a515-1fd1c4b2356e req-c57b51ec-ef76-4f66-829a-8111258b7369 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10dd91a3-b40e-4ac3-ac2c-63624e87cf93", "name": "network-vif-plugged", "status": "completed", "tag": "3c89bced-e266-4c30-8918-8d80f7f8660a"}, {"server_uuid": "c3130b20-b0cc-484a-b6b4-b4719540a6a2", "name": "network-vif-plugged", "status": "completed", "tag": "5f86201e-ee23-4c92-b757-cb0449191f53"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:31:40.707652 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:31:40.707652 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: warnings.warn(msg) Dec 15 13:31:40.708475 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-6944a617-80ce-4c7d-921f-09d542e6c7ab tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:40.716119 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-655ca3e9-2447-449a-a515-1fd1c4b2356e req-c57b51ec-ef76-4f66-829a-8111258b7369 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:40.716842 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-655ca3e9-2447-449a-a515-1fd1c4b2356e req-c57b51ec-ef76-4f66-829a-8111258b7369 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:40.716957 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-6944a617-80ce-4c7d-921f-09d542e6c7ab tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93" status: 200 len: 1318 microversion: 2.1 time: 0.236124 Dec 15 13:31:40.717451 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 66/139] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:40 2021] GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93 => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:40.730576 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-655ca3e9-2447-449a-a515-1fd1c4b2356e req-c57b51ec-ef76-4f66-829a-8111258b7369 service nova] Creating event network-vif-plugged:3c89bced-e266-4c30-8918-8d80f7f8660a for instance 10dd91a3-b40e-4ac3-ac2c-63624e87cf93 on hv-cinder-81322 Dec 15 13:31:40.731449 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-655ca3e9-2447-449a-a515-1fd1c4b2356e req-c57b51ec-ef76-4f66-829a-8111258b7369 service nova] Creating event network-vif-plugged:5f86201e-ee23-4c92-b757-cb0449191f53 for instance c3130b20-b0cc-484a-b6b4-b4719540a6a2 on hv-cinder-81322 Dec 15 13:31:40.738278 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-655ca3e9-2447-449a-a515-1fd1c4b2356e req-c57b51ec-ef76-4f66-829a-8111258b7369 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037091 Dec 15 13:31:40.739522 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 74/140] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:31:40 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:31:40.885317 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-b7331fec-2f92-43b7-80e9-72bd6e892d45 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:40.885998 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-b7331fec-2f92-43b7-80e9-72bd6e892d45 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] [instance: c3130b20-b0cc-484a-b6b4-b4719540a6a2] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:40.892887 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b7331fec-2f92-43b7-80e9-72bd6e892d45 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:40.893952 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b7331fec-2f92-43b7-80e9-72bd6e892d45 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:40.895941 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b7331fec-2f92-43b7-80e9-72bd6e892d45 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:40.897087 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b7331fec-2f92-43b7-80e9-72bd6e892d45 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:41.074834 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-b7331fec-2f92-43b7-80e9-72bd6e892d45 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07defc49f2774d9e9c7001504aa647ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6099655f06b473db6eb84adfee54156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:41.082415 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-b7331fec-2f92-43b7-80e9-72bd6e892d45 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] 10.222.0.60 "GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2" status: 200 len: 1314 microversion: 2.1 time: 0.201866 Dec 15 13:31:41.083025 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 67/141] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:40 2021] GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:31:41.299311 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-b9fa99ae-d530-4fec-a131-a66a3716747d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:41.300011 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-b9fa99ae-d530-4fec-a131-a66a3716747d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:41.308595 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b9fa99ae-d530-4fec-a131-a66a3716747d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:41.309056 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b9fa99ae-d530-4fec-a131-a66a3716747d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:41.309863 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b9fa99ae-d530-4fec-a131-a66a3716747d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:41.310304 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b9fa99ae-d530-4fec-a131-a66a3716747d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:41.384739 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-ec3d9964-86ab-470d-99fd-b6bcbe6202c9 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:41.385609 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-ec3d9964-86ab-470d-99fd-b6bcbe6202c9 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: d3c2da8c-7e29-48ac-9077-59bffb2c734b] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:41.397900 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ec3d9964-86ab-470d-99fd-b6bcbe6202c9 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:41.398338 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ec3d9964-86ab-470d-99fd-b6bcbe6202c9 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:41.399781 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ec3d9964-86ab-470d-99fd-b6bcbe6202c9 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:41.400552 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ec3d9964-86ab-470d-99fd-b6bcbe6202c9 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:41.518252 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-b9fa99ae-d530-4fec-a131-a66a3716747d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:41.551190 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-b9fa99ae-d530-4fec-a131-a66a3716747d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1364 microversion: 2.1 time: 0.256187 Dec 15 13:31:41.551777 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 75/142] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:41 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1364 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:41.602121 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-ec3d9964-86ab-470d-99fd-b6bcbe6202c9 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:41.610670 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-ec3d9964-86ab-470d-99fd-b6bcbe6202c9 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b" status: 200 len: 1322 microversion: 2.1 time: 0.233550 Dec 15 13:31:41.614420 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 68/143] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:41 2021] GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b => generated 1322 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:31:41.718221 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-680b83db-87f9-462a-8485-7854d811277d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:41.718835 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-680b83db-87f9-462a-8485-7854d811277d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:41.725356 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-680b83db-87f9-462a-8485-7854d811277d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:41.725984 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-680b83db-87f9-462a-8485-7854d811277d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:41.726784 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-680b83db-87f9-462a-8485-7854d811277d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:41.727244 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-680b83db-87f9-462a-8485-7854d811277d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:41.735207 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-2e504066-971b-496c-96ea-e10d7500ca88 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:41.736096 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-2e504066-971b-496c-96ea-e10d7500ca88 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 10dd91a3-b40e-4ac3-ac2c-63624e87cf93] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:41.743464 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2e504066-971b-496c-96ea-e10d7500ca88 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:41.745489 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2e504066-971b-496c-96ea-e10d7500ca88 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:41.746711 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2e504066-971b-496c-96ea-e10d7500ca88 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:41.747949 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2e504066-971b-496c-96ea-e10d7500ca88 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:41.964273 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-2e504066-971b-496c-96ea-e10d7500ca88 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:41.974117 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-2e504066-971b-496c-96ea-e10d7500ca88 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93" status: 200 len: 1318 microversion: 2.1 time: 0.244504 Dec 15 13:31:41.976085 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 69/144] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:41 2021] GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93 => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:31:41.979996 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-680b83db-87f9-462a-8485-7854d811277d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:41.990734 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-680b83db-87f9-462a-8485-7854d811277d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:41.996403 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-680b83db-87f9-462a-8485-7854d811277d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:42.002191 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-680b83db-87f9-462a-8485-7854d811277d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1407 microversion: 2.20 time: 0.287671 Dec 15 13:31:42.002917 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 76/145] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:31:41 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1407 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:31:42.100224 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-2721492f-2b4a-4ae0-a217-6e3047e37e74 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:42.101846 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-2721492f-2b4a-4ae0-a217-6e3047e37e74 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] [instance: c3130b20-b0cc-484a-b6b4-b4719540a6a2] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:42.110767 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2721492f-2b4a-4ae0-a217-6e3047e37e74 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:42.111451 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2721492f-2b4a-4ae0-a217-6e3047e37e74 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:42.112498 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2721492f-2b4a-4ae0-a217-6e3047e37e74 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:42.113122 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2721492f-2b4a-4ae0-a217-6e3047e37e74 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:42.271707 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-2721492f-2b4a-4ae0-a217-6e3047e37e74 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07defc49f2774d9e9c7001504aa647ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6099655f06b473db6eb84adfee54156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:42.288326 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-2721492f-2b4a-4ae0-a217-6e3047e37e74 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] 10.222.0.60 "GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2" status: 200 len: 1314 microversion: 2.1 time: 0.192808 Dec 15 13:31:42.289192 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 70/146] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:42 2021] GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:42.568903 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-cbdfe9d4-3423-48fa-b7d5-0df199d46cf2 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:42.570648 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-cbdfe9d4-3423-48fa-b7d5-0df199d46cf2 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:42.582237 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-cbdfe9d4-3423-48fa-b7d5-0df199d46cf2 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:42.582237 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-cbdfe9d4-3423-48fa-b7d5-0df199d46cf2 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:42.582237 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-cbdfe9d4-3423-48fa-b7d5-0df199d46cf2 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:42.582237 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-cbdfe9d4-3423-48fa-b7d5-0df199d46cf2 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:42.631895 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-75a74a87-552f-4556-8802-a936b2a94a54 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:42.632519 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-75a74a87-552f-4556-8802-a936b2a94a54 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: d3c2da8c-7e29-48ac-9077-59bffb2c734b] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:42.638583 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-75a74a87-552f-4556-8802-a936b2a94a54 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:42.639346 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-75a74a87-552f-4556-8802-a936b2a94a54 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:42.641219 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-75a74a87-552f-4556-8802-a936b2a94a54 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:42.642383 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-75a74a87-552f-4556-8802-a936b2a94a54 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:42.846469 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-cbdfe9d4-3423-48fa-b7d5-0df199d46cf2 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:42.856828 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-cbdfe9d4-3423-48fa-b7d5-0df199d46cf2 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1364 microversion: 2.1 time: 0.291754 Dec 15 13:31:42.857696 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 77/147] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:42 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1364 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:42.865876 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-75a74a87-552f-4556-8802-a936b2a94a54 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:42.879130 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-75a74a87-552f-4556-8802-a936b2a94a54 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b" status: 200 len: 1322 microversion: 2.1 time: 0.248422 Dec 15 13:31:42.896280 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 71/148] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:42 2021] GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b => generated 1322 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:31:42.992529 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-e0ae60ab-9ae8-4597-840e-50cdb59518cd tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:42.993146 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-e0ae60ab-9ae8-4597-840e-50cdb59518cd tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 10dd91a3-b40e-4ac3-ac2c-63624e87cf93] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:43.000284 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e0ae60ab-9ae8-4597-840e-50cdb59518cd tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:43.001264 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e0ae60ab-9ae8-4597-840e-50cdb59518cd tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:43.002423 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e0ae60ab-9ae8-4597-840e-50cdb59518cd tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:43.003130 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e0ae60ab-9ae8-4597-840e-50cdb59518cd tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:43.020691 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-8218334b-bf40-4bb1-aa53-d7249473c302 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:43.021581 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-8218334b-bf40-4bb1-aa53-d7249473c302 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:43.034335 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8218334b-bf40-4bb1-aa53-d7249473c302 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:43.035328 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8218334b-bf40-4bb1-aa53-d7249473c302 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:43.036588 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8218334b-bf40-4bb1-aa53-d7249473c302 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:43.037140 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8218334b-bf40-4bb1-aa53-d7249473c302 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:43.212166 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-e0ae60ab-9ae8-4597-840e-50cdb59518cd tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:43.219692 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-e0ae60ab-9ae8-4597-840e-50cdb59518cd tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93" status: 200 len: 1318 microversion: 2.1 time: 0.231160 Dec 15 13:31:43.223190 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 78/149] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:42 2021] GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93 => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:43.304505 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-bb7edb66-d4b0-4ed6-8086-562e8eb8131c tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:43.305131 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-bb7edb66-d4b0-4ed6-8086-562e8eb8131c tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] [instance: c3130b20-b0cc-484a-b6b4-b4719540a6a2] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:43.309681 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-8218334b-bf40-4bb1-aa53-d7249473c302 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:43.314981 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-bb7edb66-d4b0-4ed6-8086-562e8eb8131c tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:43.315444 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-bb7edb66-d4b0-4ed6-8086-562e8eb8131c tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:43.316249 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-bb7edb66-d4b0-4ed6-8086-562e8eb8131c tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:43.316687 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-bb7edb66-d4b0-4ed6-8086-562e8eb8131c tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:43.318234 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-8218334b-bf40-4bb1-aa53-d7249473c302 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:43.319749 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-8218334b-bf40-4bb1-aa53-d7249473c302 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:43.321268 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-8218334b-bf40-4bb1-aa53-d7249473c302 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1599 microversion: 2.20 time: 0.304993 Dec 15 13:31:43.322007 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 72/150] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:31:43 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1599 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:31:43.345537 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-f5a2130b-dcc5-4095-a4ac-564ba30f3326 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:43.347925 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-f5a2130b-dcc5-4095-a4ac-564ba30f3326 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:43.360879 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f5a2130b-dcc5-4095-a4ac-564ba30f3326 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:43.363978 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f5a2130b-dcc5-4095-a4ac-564ba30f3326 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:43.365084 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f5a2130b-dcc5-4095-a4ac-564ba30f3326 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:43.366663 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f5a2130b-dcc5-4095-a4ac-564ba30f3326 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:43.584795 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-bb7edb66-d4b0-4ed6-8086-562e8eb8131c tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07defc49f2774d9e9c7001504aa647ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6099655f06b473db6eb84adfee54156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:43.593492 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-bb7edb66-d4b0-4ed6-8086-562e8eb8131c tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] 10.222.0.60 "GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2" status: 200 len: 1500 microversion: 2.1 time: 0.292463 Dec 15 13:31:43.593993 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 79/151] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:43 2021] GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2 => generated 1500 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:43.610016 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-f5a2130b-dcc5-4095-a4ac-564ba30f3326 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.273173 Dec 15 13:31:43.612614 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 73/152] 10.222.0.60 () {60 vars in 1315 bytes} [Wed Dec 15 13:31:43 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/os-interface => generated 284 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:31:43.873270 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-172c3da4-9aca-406e-a098-809287f0c353 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:43.874277 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-172c3da4-9aca-406e-a098-809287f0c353 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:43.889574 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-172c3da4-9aca-406e-a098-809287f0c353 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:43.890357 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-172c3da4-9aca-406e-a098-809287f0c353 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:43.891936 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-172c3da4-9aca-406e-a098-809287f0c353 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:43.892616 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-172c3da4-9aca-406e-a098-809287f0c353 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:43.942783 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-4e8194a9-77a6-4bf0-8473-a34ea4d0f9e8 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:43.943609 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-4e8194a9-77a6-4bf0-8473-a34ea4d0f9e8 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: d3c2da8c-7e29-48ac-9077-59bffb2c734b] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:43.950054 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4e8194a9-77a6-4bf0-8473-a34ea4d0f9e8 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:43.952145 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4e8194a9-77a6-4bf0-8473-a34ea4d0f9e8 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:43.953789 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4e8194a9-77a6-4bf0-8473-a34ea4d0f9e8 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:43.957503 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4e8194a9-77a6-4bf0-8473-a34ea4d0f9e8 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:44.707639 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-172c3da4-9aca-406e-a098-809287f0c353 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:44.717292 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-4e8194a9-77a6-4bf0-8473-a34ea4d0f9e8 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:44.730220 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-4e8194a9-77a6-4bf0-8473-a34ea4d0f9e8 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b" status: 200 len: 1322 microversion: 2.1 time: 0.790954 Dec 15 13:31:44.740462 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 74/153] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:43 2021] GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b => generated 1322 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:31:44.740709 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-172c3da4-9aca-406e-a098-809287f0c353 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1364 microversion: 2.1 time: 0.861850 Dec 15 13:31:44.740709 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 80/154] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:43 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1364 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:44.741690 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-d8179f45-b12d-467a-98ab-98860aca76aa tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:44.742724 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-fcbcd9b1-6094-439e-ba0d-cfd7f7af8f91 req-0168c9b3-5b72-414e-831e-85d6433924bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eab2a5ce-9a56-4120-ae3c-ddfb844aa30a", "name": "network-vif-plugged", "status": "completed", "tag": "a1a46728-afb1-43b7-8e1d-b0e5ecdf5e2d"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:31:44.744248 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-d8179f45-b12d-467a-98ab-98860aca76aa tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 10dd91a3-b40e-4ac3-ac2c-63624e87cf93] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:44.748144 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:31:44.748144 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: warnings.warn(msg) Dec 15 13:31:44.757547 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d8179f45-b12d-467a-98ab-98860aca76aa tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:44.760111 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-fcbcd9b1-6094-439e-ba0d-cfd7f7af8f91 req-0168c9b3-5b72-414e-831e-85d6433924bb service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:44.760443 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d8179f45-b12d-467a-98ab-98860aca76aa tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:44.761518 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d8179f45-b12d-467a-98ab-98860aca76aa tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:44.762108 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d8179f45-b12d-467a-98ab-98860aca76aa tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:44.762821 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-fcbcd9b1-6094-439e-ba0d-cfd7f7af8f91 req-0168c9b3-5b72-414e-831e-85d6433924bb service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:44.787302 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-fcbcd9b1-6094-439e-ba0d-cfd7f7af8f91 req-0168c9b3-5b72-414e-831e-85d6433924bb service nova] Creating event network-vif-plugged:a1a46728-afb1-43b7-8e1d-b0e5ecdf5e2d for instance eab2a5ce-9a56-4120-ae3c-ddfb844aa30a on hv-cinder-81322 Dec 15 13:31:44.797682 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-fcbcd9b1-6094-439e-ba0d-cfd7f7af8f91 req-0168c9b3-5b72-414e-831e-85d6433924bb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064535 Dec 15 13:31:44.799193 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 75/155] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:31:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:31:45.299530 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-b9050233-6a63-4826-aefc-8f91fbf4cc91 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d6bdc42b-3f1a-42e1-883f-b68cb6f12dc0"}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:31:45.301794 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-b9050233-6a63-4826-aefc-8f91fbf4cc91 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] [instance: c3130b20-b0cc-484a-b6b4-b4719540a6a2] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:45.312342 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b9050233-6a63-4826-aefc-8f91fbf4cc91 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:45.316625 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-d8179f45-b12d-467a-98ab-98860aca76aa tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:45.324692 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b9050233-6a63-4826-aefc-8f91fbf4cc91 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:45.326875 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b9050233-6a63-4826-aefc-8f91fbf4cc91 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:45.327535 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-d8179f45-b12d-467a-98ab-98860aca76aa tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93" status: 200 len: 1508 microversion: 2.1 time: 0.587868 Dec 15 13:31:45.328312 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 81/156] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:44 2021] GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93 => generated 1508 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:45.329239 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b9050233-6a63-4826-aefc-8f91fbf4cc91 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:45.747911 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-483b0fd7-ed5c-46e5-aaf2-254222ab0fb3 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:45.748552 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-483b0fd7-ed5c-46e5-aaf2-254222ab0fb3 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: d3c2da8c-7e29-48ac-9077-59bffb2c734b] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:45.758892 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-483b0fd7-ed5c-46e5-aaf2-254222ab0fb3 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:45.759354 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-483b0fd7-ed5c-46e5-aaf2-254222ab0fb3 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:45.760182 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-483b0fd7-ed5c-46e5-aaf2-254222ab0fb3 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:45.760622 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-483b0fd7-ed5c-46e5-aaf2-254222ab0fb3 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:45.925473 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-b9050233-6a63-4826-aefc-8f91fbf4cc91 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] 10.222.0.60 "POST /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.644905 Dec 15 13:31:45.938267 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 76/157] 10.222.0.60 () {60 vars in 1322 bytes} [Wed Dec 15 13:31:45 2021] POST /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2/os-volume_attachments => generated 194 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:31:45.948685 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-4fad4aa9-7126-4c86-ae52-478df93db19c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:45.951214 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-4fad4aa9-7126-4c86-ae52-478df93db19c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:45.965165 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4fad4aa9-7126-4c86-ae52-478df93db19c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:45.966181 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4fad4aa9-7126-4c86-ae52-478df93db19c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:45.967451 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4fad4aa9-7126-4c86-ae52-478df93db19c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:45.968111 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4fad4aa9-7126-4c86-ae52-478df93db19c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:46.229470 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-483b0fd7-ed5c-46e5-aaf2-254222ab0fb3 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:46.237801 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-483b0fd7-ed5c-46e5-aaf2-254222ab0fb3 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b" status: 200 len: 1322 microversion: 2.1 time: 0.494455 Dec 15 13:31:46.239934 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 82/158] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:45 2021] GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b => generated 1322 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:31:46.246595 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-8de75e86-2a55-4402-8ddd-77c8ed822dca tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:31:46.265364 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-8de75e86-2a55-4402-8ddd-77c8ed822dca tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:46.285424 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8de75e86-2a55-4402-8ddd-77c8ed822dca tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:46.285958 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8de75e86-2a55-4402-8ddd-77c8ed822dca tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:46.287668 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8de75e86-2a55-4402-8ddd-77c8ed822dca tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:46.289286 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8de75e86-2a55-4402-8ddd-77c8ed822dca tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:46.364664 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-4fad4aa9-7126-4c86-ae52-478df93db19c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:46.375416 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-4fad4aa9-7126-4c86-ae52-478df93db19c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1364 microversion: 2.1 time: 0.434878 Dec 15 13:31:46.376053 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 77/159] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:45 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1364 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:46.389397 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-c37c1130-4655-4150-9776-ddad653f892d req-f72580a9-700e-4f77-997c-77d39f7c59d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00671676-47cb-4266-b9e5-61c7fb120355", "tag": "33030795-e868-427d-8a6a-6d48523668bc"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:31:46.391277 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:31:46.391277 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: warnings.warn(msg) Dec 15 13:31:46.401579 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-c37c1130-4655-4150-9776-ddad653f892d req-f72580a9-700e-4f77-997c-77d39f7c59d5 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:46.402295 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-c37c1130-4655-4150-9776-ddad653f892d req-f72580a9-700e-4f77-997c-77d39f7c59d5 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:46.417451 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-c37c1130-4655-4150-9776-ddad653f892d req-f72580a9-700e-4f77-997c-77d39f7c59d5 service nova] Creating event network-changed:33030795-e868-427d-8a6a-6d48523668bc for instance 00671676-47cb-4266-b9e5-61c7fb120355 on hv-cinder-81322 Dec 15 13:31:46.424632 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-c37c1130-4655-4150-9776-ddad653f892d req-f72580a9-700e-4f77-997c-77d39f7c59d5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045601 Dec 15 13:31:46.430992 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 78/160] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:31:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:31:46.505069 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-8de75e86-2a55-4402-8ddd-77c8ed822dca tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 14 microversion: 2.20 time: 0.262696 Dec 15 13:31:46.508890 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 83/161] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:31:46 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 14 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:46.952501 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-faad92a1-3aae-4d40-b5d5-5431313856e1 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b433b021-1ef8-4beb-8a18-7aad3e1c7c09"}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:31:46.954072 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-faad92a1-3aae-4d40-b5d5-5431313856e1 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 10dd91a3-b40e-4ac3-ac2c-63624e87cf93] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:46.961395 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-faad92a1-3aae-4d40-b5d5-5431313856e1 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:46.962681 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-faad92a1-3aae-4d40-b5d5-5431313856e1 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:46.963837 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-faad92a1-3aae-4d40-b5d5-5431313856e1 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:46.964499 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-faad92a1-3aae-4d40-b5d5-5431313856e1 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:47.259477 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-8b52ec91-2bee-446f-9ce7-4ce629245c77 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:47.260984 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-8b52ec91-2bee-446f-9ce7-4ce629245c77 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: d3c2da8c-7e29-48ac-9077-59bffb2c734b] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:47.274170 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8b52ec91-2bee-446f-9ce7-4ce629245c77 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:47.279183 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8b52ec91-2bee-446f-9ce7-4ce629245c77 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:47.280248 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8b52ec91-2bee-446f-9ce7-4ce629245c77 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:47.280844 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8b52ec91-2bee-446f-9ce7-4ce629245c77 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:47.457280 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-faad92a1-3aae-4d40-b5d5-5431313856e1 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "POST /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.508857 Dec 15 13:31:47.458647 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 79/162] 10.222.0.60 () {60 vars in 1322 bytes} [Wed Dec 15 13:31:46 2021] POST /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93/os-volume_attachments => generated 194 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:31:47.519348 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-17d4b039-e622-46b5-8783-95018205a352 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:47.522087 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-17d4b039-e622-46b5-8783-95018205a352 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:47.531196 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-17d4b039-e622-46b5-8783-95018205a352 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:47.531424 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-8b52ec91-2bee-446f-9ce7-4ce629245c77 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:47.532098 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-17d4b039-e622-46b5-8783-95018205a352 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:47.533585 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-17d4b039-e622-46b5-8783-95018205a352 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:47.534259 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-17d4b039-e622-46b5-8783-95018205a352 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:47.539406 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-8b52ec91-2bee-446f-9ce7-4ce629245c77 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b" status: 200 len: 1322 microversion: 2.1 time: 0.285748 Dec 15 13:31:47.539965 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 84/163] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:47 2021] GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b => generated 1322 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:47.551608 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-c751e3f3-9d23-4577-b4c9-33a64e2f104c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:31:47.552787 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-c751e3f3-9d23-4577-b4c9-33a64e2f104c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:47.563482 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c751e3f3-9d23-4577-b4c9-33a64e2f104c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:47.564217 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c751e3f3-9d23-4577-b4c9-33a64e2f104c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:47.565227 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c751e3f3-9d23-4577-b4c9-33a64e2f104c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:47.565814 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c751e3f3-9d23-4577-b4c9-33a64e2f104c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:47.651587 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-c751e3f3-9d23-4577-b4c9-33a64e2f104c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 14 microversion: 2.20 time: 0.110297 Dec 15 13:31:47.652825 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 85/164] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:31:47 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:47.857389 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-17d4b039-e622-46b5-8783-95018205a352 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:47.867544 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-17d4b039-e622-46b5-8783-95018205a352 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1364 microversion: 2.1 time: 0.378926 Dec 15 13:31:47.869198 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 80/165] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:47 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1364 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:48.139935 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-0152d202-c50a-49b7-a6c2-ea0571cb385f req-5f435c57-dc4e-4261-b4d3-996994fcacff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef0157ed-5d02-45a9-9160-55cc033a16ec", "name": "network-vif-plugged", "status": "completed", "tag": "745293fa-0314-47a0-bb77-7fceb3a9fc17"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:31:48.142932 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:31:48.142932 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: warnings.warn(msg) Dec 15 13:31:48.182165 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-0152d202-c50a-49b7-a6c2-ea0571cb385f req-5f435c57-dc4e-4261-b4d3-996994fcacff service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:48.182614 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-0152d202-c50a-49b7-a6c2-ea0571cb385f req-5f435c57-dc4e-4261-b4d3-996994fcacff service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:48.200027 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-0152d202-c50a-49b7-a6c2-ea0571cb385f req-5f435c57-dc4e-4261-b4d3-996994fcacff service nova] Creating event network-vif-plugged:745293fa-0314-47a0-bb77-7fceb3a9fc17 for instance ef0157ed-5d02-45a9-9160-55cc033a16ec on hv-cinder-81322 Dec 15 13:31:48.221749 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-0152d202-c50a-49b7-a6c2-ea0571cb385f req-5f435c57-dc4e-4261-b4d3-996994fcacff service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086709 Dec 15 13:31:48.222570 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 86/166] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:31:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:31:48.556024 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-3e20bd39-b523-4bf3-86a3-742556b86f92 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:48.557195 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-3e20bd39-b523-4bf3-86a3-742556b86f92 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: d3c2da8c-7e29-48ac-9077-59bffb2c734b] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:48.564701 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3e20bd39-b523-4bf3-86a3-742556b86f92 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:48.565433 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3e20bd39-b523-4bf3-86a3-742556b86f92 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:48.566534 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3e20bd39-b523-4bf3-86a3-742556b86f92 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:48.567189 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3e20bd39-b523-4bf3-86a3-742556b86f92 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:48.667240 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ff0969a6-21c5-4270-83f7-b03a21f1ed0b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:31:48.668142 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ff0969a6-21c5-4270-83f7-b03a21f1ed0b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:48.698366 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ff0969a6-21c5-4270-83f7-b03a21f1ed0b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:48.698976 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ff0969a6-21c5-4270-83f7-b03a21f1ed0b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:48.699815 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ff0969a6-21c5-4270-83f7-b03a21f1ed0b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:48.700252 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ff0969a6-21c5-4270-83f7-b03a21f1ed0b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:48.755222 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-3e20bd39-b523-4bf3-86a3-742556b86f92 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:48.762522 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-3e20bd39-b523-4bf3-86a3-742556b86f92 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b" status: 200 len: 1322 microversion: 2.1 time: 0.210592 Dec 15 13:31:48.763173 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 81/167] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:48 2021] GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:48.859676 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ff0969a6-21c5-4270-83f7-b03a21f1ed0b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 14 microversion: 2.20 time: 0.197554 Dec 15 13:31:48.860463 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 87/168] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:31:48 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 14 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:48.885790 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-4f05418f-e212-4834-b8f1-f761ee1486f0 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:48.886416 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-4f05418f-e212-4834-b8f1-f761ee1486f0 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:48.892320 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4f05418f-e212-4834-b8f1-f761ee1486f0 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:48.892775 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4f05418f-e212-4834-b8f1-f761ee1486f0 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:48.893564 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4f05418f-e212-4834-b8f1-f761ee1486f0 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:48.894183 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4f05418f-e212-4834-b8f1-f761ee1486f0 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:49.030712 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-4f05418f-e212-4834-b8f1-f761ee1486f0 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:49.039560 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-4f05418f-e212-4834-b8f1-f761ee1486f0 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1364 microversion: 2.1 time: 0.157759 Dec 15 13:31:49.046959 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 82/169] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:48 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:49.779560 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-0aa8913b-d6bf-44f8-a2aa-da84ca7be1bf tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:49.780247 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-0aa8913b-d6bf-44f8-a2aa-da84ca7be1bf tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: d3c2da8c-7e29-48ac-9077-59bffb2c734b] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:49.787511 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0aa8913b-d6bf-44f8-a2aa-da84ca7be1bf tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:49.787969 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0aa8913b-d6bf-44f8-a2aa-da84ca7be1bf tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:49.788757 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0aa8913b-d6bf-44f8-a2aa-da84ca7be1bf tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:49.789202 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0aa8913b-d6bf-44f8-a2aa-da84ca7be1bf tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:49.871039 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-f33e56f1-a8f7-46a1-8118-f67e585b42f0 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:31:49.872100 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-f33e56f1-a8f7-46a1-8118-f67e585b42f0 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:49.878553 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f33e56f1-a8f7-46a1-8118-f67e585b42f0 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:49.879044 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f33e56f1-a8f7-46a1-8118-f67e585b42f0 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:49.879822 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f33e56f1-a8f7-46a1-8118-f67e585b42f0 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:49.880406 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f33e56f1-a8f7-46a1-8118-f67e585b42f0 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:49.932975 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-0aa8913b-d6bf-44f8-a2aa-da84ca7be1bf tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:49.940703 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-0aa8913b-d6bf-44f8-a2aa-da84ca7be1bf tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b" status: 200 len: 1322 microversion: 2.1 time: 0.165020 Dec 15 13:31:49.941544 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 88/170] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:49 2021] GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:49.948750 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-f33e56f1-a8f7-46a1-8118-f67e585b42f0 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 14 microversion: 2.20 time: 0.081409 Dec 15 13:31:49.949576 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 83/171] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:31:49 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:31:50.056485 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-dbeed1fd-1bf5-46a9-b448-593361870c54 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:50.057119 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-dbeed1fd-1bf5-46a9-b448-593361870c54 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:50.063869 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-dbeed1fd-1bf5-46a9-b448-593361870c54 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:50.064334 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-dbeed1fd-1bf5-46a9-b448-593361870c54 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:50.072396 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-dbeed1fd-1bf5-46a9-b448-593361870c54 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:50.072396 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-dbeed1fd-1bf5-46a9-b448-593361870c54 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:50.215825 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-dbeed1fd-1bf5-46a9-b448-593361870c54 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:50.223911 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-dbeed1fd-1bf5-46a9-b448-593361870c54 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1364 microversion: 2.1 time: 0.170992 Dec 15 13:31:50.224496 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 89/172] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:50 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:50.240702 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-0cd5543b-0acc-4466-b8e2-e194ab4df62a req-b95ee826-bcd8-4158-b42e-2599e3a34e1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3c2da8c-7e29-48ac-9077-59bffb2c734b", "name": "network-vif-plugged", "status": "completed", "tag": "1f6d7b53-85b8-40d2-b216-fed7cc5d479c"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:31:50.242309 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:31:50.242309 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: warnings.warn(msg) Dec 15 13:31:50.250112 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-0cd5543b-0acc-4466-b8e2-e194ab4df62a req-b95ee826-bcd8-4158-b42e-2599e3a34e1c service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:50.250634 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-0cd5543b-0acc-4466-b8e2-e194ab4df62a req-b95ee826-bcd8-4158-b42e-2599e3a34e1c service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:50.264187 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-0cd5543b-0acc-4466-b8e2-e194ab4df62a req-b95ee826-bcd8-4158-b42e-2599e3a34e1c service nova] Creating event network-vif-plugged:1f6d7b53-85b8-40d2-b216-fed7cc5d479c for instance d3c2da8c-7e29-48ac-9077-59bffb2c734b on hv-cinder-81322 Dec 15 13:31:50.269634 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-0cd5543b-0acc-4466-b8e2-e194ab4df62a req-b95ee826-bcd8-4158-b42e-2599e3a34e1c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033049 Dec 15 13:31:50.270240 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 84/173] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:31:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:31:50.958226 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-59a6cf92-b5d3-49fe-9a38-d366f5ae6a36 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:50.958864 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-59a6cf92-b5d3-49fe-9a38-d366f5ae6a36 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: d3c2da8c-7e29-48ac-9077-59bffb2c734b] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:50.962379 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-5a04779c-12fd-4034-9bff-645e48912082 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:31:50.963408 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-5a04779c-12fd-4034-9bff-645e48912082 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:50.965189 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-59a6cf92-b5d3-49fe-9a38-d366f5ae6a36 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:50.965649 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-59a6cf92-b5d3-49fe-9a38-d366f5ae6a36 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:50.966438 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-59a6cf92-b5d3-49fe-9a38-d366f5ae6a36 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:50.966902 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-59a6cf92-b5d3-49fe-9a38-d366f5ae6a36 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:50.969317 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5a04779c-12fd-4034-9bff-645e48912082 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:50.969764 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5a04779c-12fd-4034-9bff-645e48912082 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:50.970534 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5a04779c-12fd-4034-9bff-645e48912082 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:50.970995 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5a04779c-12fd-4034-9bff-645e48912082 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:51.093911 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-59a6cf92-b5d3-49fe-9a38-d366f5ae6a36 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:51.101487 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-59a6cf92-b5d3-49fe-9a38-d366f5ae6a36 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b" status: 200 len: 1322 microversion: 2.1 time: 0.147657 Dec 15 13:31:51.102068 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 90/174] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:50 2021] GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:51.240876 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-8f7a1d2c-ca53-4f02-8ebc-7875df8300f9 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:51.241485 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-8f7a1d2c-ca53-4f02-8ebc-7875df8300f9 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:51.247411 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8f7a1d2c-ca53-4f02-8ebc-7875df8300f9 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:51.247864 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8f7a1d2c-ca53-4f02-8ebc-7875df8300f9 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:51.248644 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8f7a1d2c-ca53-4f02-8ebc-7875df8300f9 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:51.249087 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8f7a1d2c-ca53-4f02-8ebc-7875df8300f9 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:51.540621 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-8f7a1d2c-ca53-4f02-8ebc-7875df8300f9 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:51.547656 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-8f7a1d2c-ca53-4f02-8ebc-7875df8300f9 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1549 microversion: 2.1 time: 0.310961 Dec 15 13:31:51.548233 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 91/175] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:51 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1549 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:31:51.563853 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-fad17fc1-5d6a-45b8-b9a2-c9acf363d567 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:51.564350 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-fad17fc1-5d6a-45b8-b9a2-c9acf363d567 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:51.569885 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-fad17fc1-5d6a-45b8-b9a2-c9acf363d567 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:51.570339 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-fad17fc1-5d6a-45b8-b9a2-c9acf363d567 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:51.571138 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-fad17fc1-5d6a-45b8-b9a2-c9acf363d567 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:51.571576 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-fad17fc1-5d6a-45b8-b9a2-c9acf363d567 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:51.646539 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-fad17fc1-5d6a-45b8-b9a2-c9acf363d567 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.086067 Dec 15 13:31:51.647176 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 92/176] 10.222.0.60 () {58 vars in 1274 bytes} [Wed Dec 15 13:31:51 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/os-interface => generated 284 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:31:52.117753 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-77d78bd3-4ca6-4f0f-bc8d-f243cb7c76ab tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:52.118587 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-77d78bd3-4ca6-4f0f-bc8d-f243cb7c76ab tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: d3c2da8c-7e29-48ac-9077-59bffb2c734b] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:52.125005 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-77d78bd3-4ca6-4f0f-bc8d-f243cb7c76ab tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:52.125457 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-77d78bd3-4ca6-4f0f-bc8d-f243cb7c76ab tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:52.126238 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-77d78bd3-4ca6-4f0f-bc8d-f243cb7c76ab tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:52.126675 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-77d78bd3-4ca6-4f0f-bc8d-f243cb7c76ab tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:52.365939 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-77d78bd3-4ca6-4f0f-bc8d-f243cb7c76ab tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:52.373143 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-77d78bd3-4ca6-4f0f-bc8d-f243cb7c76ab tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b" status: 200 len: 1322 microversion: 2.1 time: 0.259053 Dec 15 13:31:52.373812 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 93/177] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:52 2021] GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b => generated 1322 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:31:52.633828 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-a03d59da-0505-49b1-81d6-10c92c30831d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:31:52.634766 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-a03d59da-0505-49b1-81d6-10c92c30831d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:52.640963 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a03d59da-0505-49b1-81d6-10c92c30831d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:52.641527 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a03d59da-0505-49b1-81d6-10c92c30831d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:52.642307 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a03d59da-0505-49b1-81d6-10c92c30831d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:52.642741 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a03d59da-0505-49b1-81d6-10c92c30831d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:54.699585 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-5a04779c-12fd-4034-9bff-645e48912082 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 14 microversion: 2.20 time: 3.741556 Dec 15 13:31:54.700553 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 85/178] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:31:50 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 14 bytes in 3745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:31:54.705897 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-68200fd4-7de0-414f-8944-c82c468ecbbb req-3d7d8bf6-c686-49aa-9594-ce0354978d08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef0157ed-5d02-45a9-9160-55cc033a16ec", "tag": "745293fa-0314-47a0-bb77-7fceb3a9fc17"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:31:54.707899 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:31:54.707899 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: warnings.warn(msg) Dec 15 13:31:54.716530 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-68200fd4-7de0-414f-8944-c82c468ecbbb req-3d7d8bf6-c686-49aa-9594-ce0354978d08 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:54.717142 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-68200fd4-7de0-414f-8944-c82c468ecbbb req-3d7d8bf6-c686-49aa-9594-ce0354978d08 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:54.728378 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-68200fd4-7de0-414f-8944-c82c468ecbbb req-3d7d8bf6-c686-49aa-9594-ce0354978d08 service nova] Creating event network-changed:745293fa-0314-47a0-bb77-7fceb3a9fc17 for instance ef0157ed-5d02-45a9-9160-55cc033a16ec on hv-cinder-81322 Dec 15 13:31:54.733313 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-68200fd4-7de0-414f-8944-c82c468ecbbb req-3d7d8bf6-c686-49aa-9594-ce0354978d08 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031417 Dec 15 13:31:54.734058 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 86/179] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:31:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:31:54.738514 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-0c52a537-9dbb-4745-8ff3-da931fcfcb96 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:54.739534 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-0c52a537-9dbb-4745-8ff3-da931fcfcb96 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: d3c2da8c-7e29-48ac-9077-59bffb2c734b] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:54.745082 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0c52a537-9dbb-4745-8ff3-da931fcfcb96 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:54.745527 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0c52a537-9dbb-4745-8ff3-da931fcfcb96 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:54.746300 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0c52a537-9dbb-4745-8ff3-da931fcfcb96 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:54.746735 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0c52a537-9dbb-4745-8ff3-da931fcfcb96 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:54.875860 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-0c52a537-9dbb-4745-8ff3-da931fcfcb96 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:54.883613 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-0c52a537-9dbb-4745-8ff3-da931fcfcb96 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b" status: 200 len: 1322 microversion: 2.1 time: 0.148662 Dec 15 13:31:54.884184 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 87/180] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:54 2021] GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:55.014581 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-a03d59da-0505-49b1-81d6-10c92c30831d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 14 microversion: 2.1 time: 2.384298 Dec 15 13:31:55.015432 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 94/181] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:31:52 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 14 bytes in 2386 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 13:31:55.709596 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-4795cf87-2ba2-4b6c-bbf3-a4b37cf0c0fe tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:31:55.710501 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-4795cf87-2ba2-4b6c-bbf3-a4b37cf0c0fe tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:55.719639 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4795cf87-2ba2-4b6c-bbf3-a4b37cf0c0fe tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:55.720347 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4795cf87-2ba2-4b6c-bbf3-a4b37cf0c0fe tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:55.722526 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4795cf87-2ba2-4b6c-bbf3-a4b37cf0c0fe tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:55.723271 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4795cf87-2ba2-4b6c-bbf3-a4b37cf0c0fe tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:55.876887 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-4795cf87-2ba2-4b6c-bbf3-a4b37cf0c0fe tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 14 microversion: 2.20 time: 0.170742 Dec 15 13:31:55.877707 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 88/182] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:31:55 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 14 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:55.900444 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-5d91493e-4ced-43c9-8cd9-d84a48413bed tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:55.901152 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-5d91493e-4ced-43c9-8cd9-d84a48413bed tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: d3c2da8c-7e29-48ac-9077-59bffb2c734b] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:55.908200 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5d91493e-4ced-43c9-8cd9-d84a48413bed tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:55.908645 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5d91493e-4ced-43c9-8cd9-d84a48413bed tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:55.910236 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5d91493e-4ced-43c9-8cd9-d84a48413bed tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:55.910690 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5d91493e-4ced-43c9-8cd9-d84a48413bed tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:56.028586 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-a5e48462-4352-4582-b6fb-68fc6621347c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:31:56.029600 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-a5e48462-4352-4582-b6fb-68fc6621347c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:56.046873 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a5e48462-4352-4582-b6fb-68fc6621347c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:56.047598 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a5e48462-4352-4582-b6fb-68fc6621347c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:56.050485 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a5e48462-4352-4582-b6fb-68fc6621347c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:56.051260 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a5e48462-4352-4582-b6fb-68fc6621347c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:56.063001 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-5d91493e-4ced-43c9-8cd9-d84a48413bed tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:56.070796 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-5d91493e-4ced-43c9-8cd9-d84a48413bed tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b" status: 200 len: 1322 microversion: 2.1 time: 0.174269 Dec 15 13:31:56.080974 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 95/183] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:55 2021] GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b => generated 1322 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:56.186247 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-a5e48462-4352-4582-b6fb-68fc6621347c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 14 microversion: 2.1 time: 0.163657 Dec 15 13:31:56.187083 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 89/184] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:31:56 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 14 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:31:56.887662 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-67723650-dddb-465b-aef7-6810dddfde44 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:31:56.888622 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-67723650-dddb-465b-aef7-6810dddfde44 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:56.894815 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-67723650-dddb-465b-aef7-6810dddfde44 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:56.895297 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-67723650-dddb-465b-aef7-6810dddfde44 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:56.896118 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-67723650-dddb-465b-aef7-6810dddfde44 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:56.896783 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-67723650-dddb-465b-aef7-6810dddfde44 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:57.006068 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-67723650-dddb-465b-aef7-6810dddfde44 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 14 microversion: 2.20 time: 0.121837 Dec 15 13:31:57.006736 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 96/185] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:31:56 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:57.088206 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-e93cd74b-960e-4b29-8e32-028bcd6e9d57 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:57.089442 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-e93cd74b-960e-4b29-8e32-028bcd6e9d57 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: d3c2da8c-7e29-48ac-9077-59bffb2c734b] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:57.097953 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e93cd74b-960e-4b29-8e32-028bcd6e9d57 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:57.098649 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e93cd74b-960e-4b29-8e32-028bcd6e9d57 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:57.099622 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e93cd74b-960e-4b29-8e32-028bcd6e9d57 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:57.100211 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e93cd74b-960e-4b29-8e32-028bcd6e9d57 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:57.198251 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-c689235e-7ea9-4947-b662-04ca34077c02 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:31:57.199487 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-c689235e-7ea9-4947-b662-04ca34077c02 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:57.206585 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c689235e-7ea9-4947-b662-04ca34077c02 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:57.207071 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c689235e-7ea9-4947-b662-04ca34077c02 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:57.208118 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c689235e-7ea9-4947-b662-04ca34077c02 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:57.208561 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c689235e-7ea9-4947-b662-04ca34077c02 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:57.298013 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-e93cd74b-960e-4b29-8e32-028bcd6e9d57 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:57.307481 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-e93cd74b-960e-4b29-8e32-028bcd6e9d57 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b" status: 200 len: 1322 microversion: 2.1 time: 0.223358 Dec 15 13:31:57.308217 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 90/186] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:57 2021] GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:57.312438 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-c689235e-7ea9-4947-b662-04ca34077c02 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 14 microversion: 2.1 time: 0.118094 Dec 15 13:31:57.313082 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 97/187] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:31:57 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 13:31:58.018315 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-93746a6e-b09c-456a-9596-a9052e430a01 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:31:58.020028 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-93746a6e-b09c-456a-9596-a9052e430a01 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:58.027178 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-93746a6e-b09c-456a-9596-a9052e430a01 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:58.027875 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-93746a6e-b09c-456a-9596-a9052e430a01 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:58.028820 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-93746a6e-b09c-456a-9596-a9052e430a01 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:58.029404 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-93746a6e-b09c-456a-9596-a9052e430a01 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:58.118374 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-93746a6e-b09c-456a-9596-a9052e430a01 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 14 microversion: 2.20 time: 0.104524 Dec 15 13:31:58.121670 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 91/188] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:31:58 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:58.324745 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-e90934c0-daea-4bea-9534-e98152365a21 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:31:58.325280 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-8dea1bfe-81f0-4607-acd4-2c6fd83ec625 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:58.326028 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-8dea1bfe-81f0-4607-acd4-2c6fd83ec625 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: d3c2da8c-7e29-48ac-9077-59bffb2c734b] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:58.327013 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-e90934c0-daea-4bea-9534-e98152365a21 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:58.333329 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8dea1bfe-81f0-4607-acd4-2c6fd83ec625 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:58.333776 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8dea1bfe-81f0-4607-acd4-2c6fd83ec625 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:58.334565 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8dea1bfe-81f0-4607-acd4-2c6fd83ec625 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:58.335106 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8dea1bfe-81f0-4607-acd4-2c6fd83ec625 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:58.335704 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e90934c0-daea-4bea-9534-e98152365a21 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:58.336482 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e90934c0-daea-4bea-9534-e98152365a21 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:58.337493 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e90934c0-daea-4bea-9534-e98152365a21 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:58.338139 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e90934c0-daea-4bea-9534-e98152365a21 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:58.431680 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-e90934c0-daea-4bea-9534-e98152365a21 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 14 microversion: 2.1 time: 0.110693 Dec 15 13:31:58.431879 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 98/189] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:31:58 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:31:58.537762 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-8dea1bfe-81f0-4607-acd4-2c6fd83ec625 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:58.547038 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-8dea1bfe-81f0-4607-acd4-2c6fd83ec625 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b" status: 200 len: 1516 microversion: 2.1 time: 0.225617 Dec 15 13:31:58.547654 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 92/190] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:58 2021] GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b => generated 1516 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:31:58.564686 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-2de6eb16-2e49-4c5c-b777-1d9b9d5b8004 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:31:58.566249 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-2de6eb16-2e49-4c5c-b777-1d9b9d5b8004 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: d3c2da8c-7e29-48ac-9077-59bffb2c734b] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:58.573876 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2de6eb16-2e49-4c5c-b777-1d9b9d5b8004 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:58.574582 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2de6eb16-2e49-4c5c-b777-1d9b9d5b8004 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:58.575411 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2de6eb16-2e49-4c5c-b777-1d9b9d5b8004 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:58.576195 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2de6eb16-2e49-4c5c-b777-1d9b9d5b8004 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:58.602813 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.objects.instance [None req-2de6eb16-2e49-4c5c-b777-1d9b9d5b8004 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lazy-loading 'flavor' on Instance uuid d3c2da8c-7e29-48ac-9077-59bffb2c734b {{(pid=116942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:31:58.773666 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-2de6eb16-2e49-4c5c-b777-1d9b9d5b8004 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "POST /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b/action" status: 200 len: 32 microversion: 2.1 time: 0.213783 Dec 15 13:31:58.778075 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 99/191] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:31:58 2021] POST /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b/action => generated 32 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:31:58.784661 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-d37c0f82-2ef2-4be5-afef-c7968d0790e4 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:58.785408 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-d37c0f82-2ef2-4be5-afef-c7968d0790e4 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: d3c2da8c-7e29-48ac-9077-59bffb2c734b] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:58.791788 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d37c0f82-2ef2-4be5-afef-c7968d0790e4 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:58.792519 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d37c0f82-2ef2-4be5-afef-c7968d0790e4 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:58.793509 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d37c0f82-2ef2-4be5-afef-c7968d0790e4 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:58.802268 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d37c0f82-2ef2-4be5-afef-c7968d0790e4 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:58.873750 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-c87934ed-8593-4224-9ab8-a78696f3d212 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:58.874816 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-c87934ed-8593-4224-9ab8-a78696f3d212 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] [instance: c3130b20-b0cc-484a-b6b4-b4719540a6a2] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:58.885079 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c87934ed-8593-4224-9ab8-a78696f3d212 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:58.885809 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c87934ed-8593-4224-9ab8-a78696f3d212 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:58.886981 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c87934ed-8593-4224-9ab8-a78696f3d212 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:58.887625 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c87934ed-8593-4224-9ab8-a78696f3d212 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:58.921231 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-c87934ed-8593-4224-9ab8-a78696f3d212 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] [instance: c3130b20-b0cc-484a-b6b4-b4719540a6a2] Going to try to terminate instance {{(pid=116942) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:31:59.025669 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-c87934ed-8593-4224-9ab8-a78696f3d212 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2" status: 204 len: 0 microversion: 2.1 time: 0.159655 Dec 15 13:31:59.026421 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 100/192] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Dec 15 13:31:58 2021] DELETE /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 15 13:31:59.031327 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-d37c0f82-2ef2-4be5-afef-c7968d0790e4 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:59.035454 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-b830eaa4-8db4-4003-bcda-970dfc6db08d tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:59.036212 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-b830eaa4-8db4-4003-bcda-970dfc6db08d tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] [instance: c3130b20-b0cc-484a-b6b4-b4719540a6a2] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:59.041223 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-d37c0f82-2ef2-4be5-afef-c7968d0790e4 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b" status: 200 len: 1522 microversion: 2.1 time: 0.261087 Dec 15 13:31:59.053262 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 93/193] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:58 2021] GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:59.053396 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b830eaa4-8db4-4003-bcda-970dfc6db08d tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:59.053736 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b830eaa4-8db4-4003-bcda-970dfc6db08d tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:59.054582 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b830eaa4-8db4-4003-bcda-970dfc6db08d tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:59.055122 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b830eaa4-8db4-4003-bcda-970dfc6db08d tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:59.135646 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-bb43e92a-528a-435a-9370-2c980afbd86a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:31:59.137386 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-bb43e92a-528a-435a-9370-2c980afbd86a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:59.145102 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bb43e92a-528a-435a-9370-2c980afbd86a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:59.145810 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bb43e92a-528a-435a-9370-2c980afbd86a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:59.146899 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bb43e92a-528a-435a-9370-2c980afbd86a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:59.147510 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bb43e92a-528a-435a-9370-2c980afbd86a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:59.220330 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-b830eaa4-8db4-4003-bcda-970dfc6db08d tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07defc49f2774d9e9c7001504aa647ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6099655f06b473db6eb84adfee54156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:31:59.236619 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-b830eaa4-8db4-4003-bcda-970dfc6db08d tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] 10.222.0.60 "GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2" status: 200 len: 1552 microversion: 2.1 time: 0.205579 Dec 15 13:31:59.238243 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 101/194] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:31:59 2021] GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2 => generated 1552 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:31:59.243342 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-bb43e92a-528a-435a-9370-2c980afbd86a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 6451 microversion: 2.20 time: 0.112996 Dec 15 13:31:59.246818 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 94/195] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:31:59 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 6451 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:31:59.442093 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-d14eb726-7402-4e4e-aac0-6d3d5a254bef tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:31:59.443807 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-d14eb726-7402-4e4e-aac0-6d3d5a254bef tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:31:59.450554 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d14eb726-7402-4e4e-aac0-6d3d5a254bef tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:59.451488 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d14eb726-7402-4e4e-aac0-6d3d5a254bef tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:59.452488 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d14eb726-7402-4e4e-aac0-6d3d5a254bef tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:31:59.453393 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d14eb726-7402-4e4e-aac0-6d3d5a254bef tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:31:59.555414 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-d14eb726-7402-4e4e-aac0-6d3d5a254bef tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 14 microversion: 2.1 time: 0.116331 Dec 15 13:31:59.556068 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 102/196] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:31:59 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:32:00.059314 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-5d980180-77f8-48a9-ba80-e5d1c43f0c11 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:32:00.060424 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-5d980180-77f8-48a9-ba80-e5d1c43f0c11 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: d3c2da8c-7e29-48ac-9077-59bffb2c734b] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:00.068372 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5d980180-77f8-48a9-ba80-e5d1c43f0c11 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:00.069081 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5d980180-77f8-48a9-ba80-e5d1c43f0c11 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:00.069614 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5d980180-77f8-48a9-ba80-e5d1c43f0c11 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:00.070055 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5d980180-77f8-48a9-ba80-e5d1c43f0c11 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:00.224040 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-5d980180-77f8-48a9-ba80-e5d1c43f0c11 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:32:00.231859 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-5d980180-77f8-48a9-ba80-e5d1c43f0c11 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b" status: 200 len: 1522 microversion: 2.1 time: 0.176569 Dec 15 13:32:00.242483 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 95/197] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:32:00 2021] GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:32:00.255697 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-76f33483-b03b-4740-bf71-9fd881796019 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:32:00.256842 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-76f33483-b03b-4740-bf71-9fd881796019 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:00.268775 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-50f8e28d-8902-4621-a44c-ab88b64af30d tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:32:00.270967 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-50f8e28d-8902-4621-a44c-ab88b64af30d tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] [instance: c3130b20-b0cc-484a-b6b4-b4719540a6a2] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:00.272179 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-76f33483-b03b-4740-bf71-9fd881796019 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:00.274163 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-76f33483-b03b-4740-bf71-9fd881796019 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:00.275494 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-76f33483-b03b-4740-bf71-9fd881796019 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:00.277132 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-76f33483-b03b-4740-bf71-9fd881796019 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:00.282761 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-50f8e28d-8902-4621-a44c-ab88b64af30d tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:00.285146 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-50f8e28d-8902-4621-a44c-ab88b64af30d tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:00.286153 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-50f8e28d-8902-4621-a44c-ab88b64af30d tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:00.287798 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-50f8e28d-8902-4621-a44c-ab88b64af30d tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:00.423111 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-76f33483-b03b-4740-bf71-9fd881796019 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 10658 microversion: 2.20 time: 0.173013 Dec 15 13:32:00.423754 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 103/198] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:32:00 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 10658 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:32:00.486554 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-50f8e28d-8902-4621-a44c-ab88b64af30d tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07defc49f2774d9e9c7001504aa647ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6099655f06b473db6eb84adfee54156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:32:00.506817 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-50f8e28d-8902-4621-a44c-ab88b64af30d tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] 10.222.0.60 "GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2" status: 200 len: 1552 microversion: 2.1 time: 0.245837 Dec 15 13:32:00.507861 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 96/199] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:32:00 2021] GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2 => generated 1552 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:32:00.567205 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-03de80d3-5849-428c-9724-a2fbef81205b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:32:00.568210 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-03de80d3-5849-428c-9724-a2fbef81205b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:00.576086 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-03de80d3-5849-428c-9724-a2fbef81205b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:00.576822 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-03de80d3-5849-428c-9724-a2fbef81205b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:00.577967 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-03de80d3-5849-428c-9724-a2fbef81205b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:00.579185 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-03de80d3-5849-428c-9724-a2fbef81205b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:00.671948 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-03de80d3-5849-428c-9724-a2fbef81205b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 14 microversion: 2.1 time: 0.109803 Dec 15 13:32:00.672667 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 104/200] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:32:00 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:32:01.248135 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-03f52bf8-01b2-4689-a6b5-40e1e0a2bb5b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:32:01.248754 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-03f52bf8-01b2-4689-a6b5-40e1e0a2bb5b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: d3c2da8c-7e29-48ac-9077-59bffb2c734b] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:01.255900 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-03f52bf8-01b2-4689-a6b5-40e1e0a2bb5b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:01.256359 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-03f52bf8-01b2-4689-a6b5-40e1e0a2bb5b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:01.257144 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-03f52bf8-01b2-4689-a6b5-40e1e0a2bb5b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:01.257593 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-03f52bf8-01b2-4689-a6b5-40e1e0a2bb5b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:01.390523 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-03f52bf8-01b2-4689-a6b5-40e1e0a2bb5b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:32:01.399190 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-03f52bf8-01b2-4689-a6b5-40e1e0a2bb5b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b" status: 200 len: 1522 microversion: 2.1 time: 0.154851 Dec 15 13:32:01.399758 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 97/201] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:32:01 2021] GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:32:01.435021 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ab65465c-ae3f-46c0-bec9-3111e1669f90 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:32:01.436002 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ab65465c-ae3f-46c0-bec9-3111e1669f90 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:01.442717 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ab65465c-ae3f-46c0-bec9-3111e1669f90 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:01.443190 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ab65465c-ae3f-46c0-bec9-3111e1669f90 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:01.443979 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ab65465c-ae3f-46c0-bec9-3111e1669f90 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:01.444426 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ab65465c-ae3f-46c0-bec9-3111e1669f90 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:01.524395 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-41bdd1be-08d9-443e-8bda-d4ff9afe3afd tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:32:01.524951 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-41bdd1be-08d9-443e-8bda-d4ff9afe3afd tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] [instance: c3130b20-b0cc-484a-b6b4-b4719540a6a2] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:01.527165 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ab65465c-ae3f-46c0-bec9-3111e1669f90 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 15025 microversion: 2.20 time: 0.095927 Dec 15 13:32:01.528644 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 105/202] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:32:01 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 15025 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:32:01.530837 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-41bdd1be-08d9-443e-8bda-d4ff9afe3afd tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:01.531315 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-41bdd1be-08d9-443e-8bda-d4ff9afe3afd tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:01.532097 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-41bdd1be-08d9-443e-8bda-d4ff9afe3afd tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:01.532531 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-41bdd1be-08d9-443e-8bda-d4ff9afe3afd tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:01.659151 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-41bdd1be-08d9-443e-8bda-d4ff9afe3afd tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07defc49f2774d9e9c7001504aa647ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6099655f06b473db6eb84adfee54156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:32:01.667010 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-41bdd1be-08d9-443e-8bda-d4ff9afe3afd tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] 10.222.0.60 "GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2" status: 200 len: 1552 microversion: 2.1 time: 0.146478 Dec 15 13:32:01.667597 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 98/203] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:32:01 2021] GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2 => generated 1552 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:32:01.683488 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-d76516ed-440c-466f-abdd-da4cc3bc0e79 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:32:01.684472 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-d76516ed-440c-466f-abdd-da4cc3bc0e79 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:01.691995 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d76516ed-440c-466f-abdd-da4cc3bc0e79 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:01.692451 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d76516ed-440c-466f-abdd-da4cc3bc0e79 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:01.693247 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d76516ed-440c-466f-abdd-da4cc3bc0e79 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:01.693782 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d76516ed-440c-466f-abdd-da4cc3bc0e79 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:01.779996 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-d76516ed-440c-466f-abdd-da4cc3bc0e79 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 14 microversion: 2.1 time: 0.100426 Dec 15 13:32:01.780577 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 106/204] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:32:01 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:32:02.416701 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-3b4b3dee-5b35-4d8c-84ae-5ddf8cfb4dc0 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:32:02.419274 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-3b4b3dee-5b35-4d8c-84ae-5ddf8cfb4dc0 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: d3c2da8c-7e29-48ac-9077-59bffb2c734b] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:02.427634 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3b4b3dee-5b35-4d8c-84ae-5ddf8cfb4dc0 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:02.428089 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3b4b3dee-5b35-4d8c-84ae-5ddf8cfb4dc0 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:02.428874 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3b4b3dee-5b35-4d8c-84ae-5ddf8cfb4dc0 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:02.429312 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3b4b3dee-5b35-4d8c-84ae-5ddf8cfb4dc0 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:02.539682 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-3b985d12-a6d1-4381-b88b-0f97351133f9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:32:02.541035 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-3b985d12-a6d1-4381-b88b-0f97351133f9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:02.547892 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3b985d12-a6d1-4381-b88b-0f97351133f9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:02.548412 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3b985d12-a6d1-4381-b88b-0f97351133f9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:02.549211 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3b985d12-a6d1-4381-b88b-0f97351133f9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:02.549787 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3b985d12-a6d1-4381-b88b-0f97351133f9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:02.563238 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-3b4b3dee-5b35-4d8c-84ae-5ddf8cfb4dc0 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:32:02.570425 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-3b4b3dee-5b35-4d8c-84ae-5ddf8cfb4dc0 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b" status: 200 len: 1522 microversion: 2.1 time: 0.157454 Dec 15 13:32:02.571026 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 99/205] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:32:02 2021] GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:32:02.654966 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-3b985d12-a6d1-4381-b88b-0f97351133f9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 17861 microversion: 2.20 time: 0.119840 Dec 15 13:32:02.655859 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 107/206] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:32:02 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 17861 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:32:02.683858 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-a6adb9c4-e7b7-4dae-b05d-585d9da00792 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:32:02.684474 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-a6adb9c4-e7b7-4dae-b05d-585d9da00792 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] [instance: c3130b20-b0cc-484a-b6b4-b4719540a6a2] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:02.690825 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a6adb9c4-e7b7-4dae-b05d-585d9da00792 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:02.691432 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a6adb9c4-e7b7-4dae-b05d-585d9da00792 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:02.692295 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a6adb9c4-e7b7-4dae-b05d-585d9da00792 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:02.692797 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a6adb9c4-e7b7-4dae-b05d-585d9da00792 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:02.791747 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-669e99a9-6c7f-41f5-be1e-d4536bd0165e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:32:02.792744 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-669e99a9-6c7f-41f5-be1e-d4536bd0165e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:02.799794 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-669e99a9-6c7f-41f5-be1e-d4536bd0165e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:02.800249 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-669e99a9-6c7f-41f5-be1e-d4536bd0165e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:02.801294 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-669e99a9-6c7f-41f5-be1e-d4536bd0165e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:02.801733 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-669e99a9-6c7f-41f5-be1e-d4536bd0165e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:02.840058 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-a6adb9c4-e7b7-4dae-b05d-585d9da00792 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07defc49f2774d9e9c7001504aa647ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6099655f06b473db6eb84adfee54156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:32:02.848260 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-a6adb9c4-e7b7-4dae-b05d-585d9da00792 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] 10.222.0.60 "GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2" status: 200 len: 1552 microversion: 2.1 time: 0.167605 Dec 15 13:32:02.848859 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 100/207] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:32:02 2021] GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2 => generated 1552 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:32:02.875890 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-669e99a9-6c7f-41f5-be1e-d4536bd0165e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 14 microversion: 2.1 time: 0.088016 Dec 15 13:32:02.878984 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 108/208] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:32:02 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:32:03.242463 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-49beea75-7e3d-47f6-89d5-19ad4976ee72 req-9704f885-a1d9-4b19-84f3-d9082a58facb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3130b20-b0cc-484a-b6b4-b4719540a6a2", "name": "network-vif-deleted", "tag": "5f86201e-ee23-4c92-b757-cb0449191f53"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:32:03.244103 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:32:03.244103 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: warnings.warn(msg) Dec 15 13:32:03.254212 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-49beea75-7e3d-47f6-89d5-19ad4976ee72 req-9704f885-a1d9-4b19-84f3-d9082a58facb service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:03.254212 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-49beea75-7e3d-47f6-89d5-19ad4976ee72 req-9704f885-a1d9-4b19-84f3-d9082a58facb service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:03.266973 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-49beea75-7e3d-47f6-89d5-19ad4976ee72 req-9704f885-a1d9-4b19-84f3-d9082a58facb service nova] Creating event network-vif-deleted:5f86201e-ee23-4c92-b757-cb0449191f53 for instance c3130b20-b0cc-484a-b6b4-b4719540a6a2 on hv-cinder-81322 Dec 15 13:32:03.272923 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-49beea75-7e3d-47f6-89d5-19ad4976ee72 req-9704f885-a1d9-4b19-84f3-d9082a58facb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040716 Dec 15 13:32:03.274026 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 101/209] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:32:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:32:03.588308 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-23ae8d1d-d154-48e1-85f1-d010a64ebef8 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:32:03.589142 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-23ae8d1d-d154-48e1-85f1-d010a64ebef8 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: d3c2da8c-7e29-48ac-9077-59bffb2c734b] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:03.596988 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-23ae8d1d-d154-48e1-85f1-d010a64ebef8 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:03.597474 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-23ae8d1d-d154-48e1-85f1-d010a64ebef8 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:03.598273 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-23ae8d1d-d154-48e1-85f1-d010a64ebef8 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:03.598732 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-23ae8d1d-d154-48e1-85f1-d010a64ebef8 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:03.667776 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-350dd752-fd51-4010-b2ae-7beec8d20689 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:32:03.668769 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-350dd752-fd51-4010-b2ae-7beec8d20689 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:03.679056 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-350dd752-fd51-4010-b2ae-7beec8d20689 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:03.679488 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-350dd752-fd51-4010-b2ae-7beec8d20689 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:03.680267 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-350dd752-fd51-4010-b2ae-7beec8d20689 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:03.680695 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-350dd752-fd51-4010-b2ae-7beec8d20689 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:03.767726 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-23ae8d1d-d154-48e1-85f1-d010a64ebef8 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:32:03.775407 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-23ae8d1d-d154-48e1-85f1-d010a64ebef8 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b" status: 200 len: 1522 microversion: 2.1 time: 0.191159 Dec 15 13:32:03.775982 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 109/210] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:32:03 2021] GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:32:03.840881 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-350dd752-fd51-4010-b2ae-7beec8d20689 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 17960 microversion: 2.20 time: 0.177314 Dec 15 13:32:03.841566 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 102/211] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:32:03 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 17960 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:32:03.866021 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-3d5e3804-a85f-4dbb-b44e-33790e79b2c9 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:32:03.866642 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-3d5e3804-a85f-4dbb-b44e-33790e79b2c9 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] [instance: c3130b20-b0cc-484a-b6b4-b4719540a6a2] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:03.873585 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3d5e3804-a85f-4dbb-b44e-33790e79b2c9 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:03.874038 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3d5e3804-a85f-4dbb-b44e-33790e79b2c9 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:03.874883 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3d5e3804-a85f-4dbb-b44e-33790e79b2c9 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:03.875325 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3d5e3804-a85f-4dbb-b44e-33790e79b2c9 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:03.887084 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-228080cc-ec01-4a76-97bb-a3884810eaf4 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:32:03.888277 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-228080cc-ec01-4a76-97bb-a3884810eaf4 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:03.895178 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-228080cc-ec01-4a76-97bb-a3884810eaf4 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:03.896080 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-228080cc-ec01-4a76-97bb-a3884810eaf4 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:03.898099 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-228080cc-ec01-4a76-97bb-a3884810eaf4 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:03.898538 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-228080cc-ec01-4a76-97bb-a3884810eaf4 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:03.912961 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3d5e3804-a85f-4dbb-b44e-33790e79b2c9 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:03.913419 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3d5e3804-a85f-4dbb-b44e-33790e79b2c9 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:03.913874 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.objects.instance [None req-3d5e3804-a85f-4dbb-b44e-33790e79b2c9 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lazy-loading 'fault' on Instance uuid c3130b20-b0cc-484a-b6b4-b4719540a6a2 {{(pid=116942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:32:03.955414 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-3d5e3804-a85f-4dbb-b44e-33790e79b2c9 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07defc49f2774d9e9c7001504aa647ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6099655f06b473db6eb84adfee54156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:32:03.963633 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-3d5e3804-a85f-4dbb-b44e-33790e79b2c9 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] 10.222.0.60 "GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2" status: 200 len: 1350 microversion: 2.1 time: 0.102402 Dec 15 13:32:03.964318 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 110/212] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:32:03 2021] GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2 => generated 1350 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:32:03.998120 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-228080cc-ec01-4a76-97bb-a3884810eaf4 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 14 microversion: 2.1 time: 0.114408 Dec 15 13:32:04.002053 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 103/213] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:32:03 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 13:32:04.791999 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-f70554dc-aa98-4f7c-a238-a402a92ba9fc tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:32:04.792700 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-f70554dc-aa98-4f7c-a238-a402a92ba9fc tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: d3c2da8c-7e29-48ac-9077-59bffb2c734b] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:04.798788 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f70554dc-aa98-4f7c-a238-a402a92ba9fc tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:04.799271 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f70554dc-aa98-4f7c-a238-a402a92ba9fc tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:04.800049 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f70554dc-aa98-4f7c-a238-a402a92ba9fc tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:04.800484 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f70554dc-aa98-4f7c-a238-a402a92ba9fc tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:04.852679 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-36a0a467-c03f-4684-9674-3ed94162cbf8 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:32:04.853877 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-36a0a467-c03f-4684-9674-3ed94162cbf8 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:04.861585 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-36a0a467-c03f-4684-9674-3ed94162cbf8 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:04.862045 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-36a0a467-c03f-4684-9674-3ed94162cbf8 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:04.863544 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-36a0a467-c03f-4684-9674-3ed94162cbf8 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:04.863990 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-36a0a467-c03f-4684-9674-3ed94162cbf8 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:04.934378 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-f70554dc-aa98-4f7c-a238-a402a92ba9fc tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:32:04.942336 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-f70554dc-aa98-4f7c-a238-a402a92ba9fc tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b" status: 200 len: 1522 microversion: 2.1 time: 0.154033 Dec 15 13:32:04.942613 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-36a0a467-c03f-4684-9674-3ed94162cbf8 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 19342 microversion: 2.20 time: 0.093792 Dec 15 13:32:04.942935 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 111/214] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:32:04 2021] GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:32:04.946284 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 104/215] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:32:04 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 19342 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:32:04.984028 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ca6b3357-d049-4a50-b86f-bbbe649bfc1f tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:32:04.984719 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ca6b3357-d049-4a50-b86f-bbbe649bfc1f tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] [instance: c3130b20-b0cc-484a-b6b4-b4719540a6a2] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:04.991084 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ca6b3357-d049-4a50-b86f-bbbe649bfc1f tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:04.991612 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ca6b3357-d049-4a50-b86f-bbbe649bfc1f tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:04.992401 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ca6b3357-d049-4a50-b86f-bbbe649bfc1f tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:04.992844 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ca6b3357-d049-4a50-b86f-bbbe649bfc1f tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:05.006770 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.wsgi [None req-ca6b3357-d049-4a50-b86f-bbbe649bfc1f tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] HTTP exception thrown: Instance c3130b20-b0cc-484a-b6b4-b4719540a6a2 could not be found. Dec 15 13:32:05.007419 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ca6b3357-d049-4a50-b86f-bbbe649bfc1f tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Returning 404 to user: Instance c3130b20-b0cc-484a-b6b4-b4719540a6a2 could not be found. {{(pid=116942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:32:05.008248 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ca6b3357-d049-4a50-b86f-bbbe649bfc1f tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] 10.222.0.60 "GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2" status: 404 len: 111 microversion: 2.1 time: 0.028069 Dec 15 13:32:05.008948 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 112/216] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:32:04 2021] GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:32:05.011110 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-be7301c4-160e-4578-ae74-3b831c25ca5e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:32:05.012352 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-be7301c4-160e-4578-ae74-3b831c25ca5e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:05.019925 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-be7301c4-160e-4578-ae74-3b831c25ca5e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:05.020402 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-be7301c4-160e-4578-ae74-3b831c25ca5e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:05.021261 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-be7301c4-160e-4578-ae74-3b831c25ca5e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:05.021769 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-be7301c4-160e-4578-ae74-3b831c25ca5e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:05.109806 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-922aef40-6ed7-489c-873d-049b5fab1716 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:32:05.110722 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-922aef40-6ed7-489c-873d-049b5fab1716 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] [instance: c3130b20-b0cc-484a-b6b4-b4719540a6a2] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:05.116801 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-be7301c4-160e-4578-ae74-3b831c25ca5e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 14 microversion: 2.1 time: 0.110099 Dec 15 13:32:05.117541 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-922aef40-6ed7-489c-873d-049b5fab1716 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:05.117897 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 105/217] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:32:05 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 13:32:05.118112 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-922aef40-6ed7-489c-873d-049b5fab1716 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:05.118768 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-922aef40-6ed7-489c-873d-049b5fab1716 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:05.119389 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-922aef40-6ed7-489c-873d-049b5fab1716 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:05.132905 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.wsgi [None req-922aef40-6ed7-489c-873d-049b5fab1716 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] HTTP exception thrown: Instance c3130b20-b0cc-484a-b6b4-b4719540a6a2 could not be found. Dec 15 13:32:05.133683 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-922aef40-6ed7-489c-873d-049b5fab1716 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Returning 404 to user: Instance c3130b20-b0cc-484a-b6b4-b4719540a6a2 could not be found. {{(pid=116942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:32:05.134572 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-922aef40-6ed7-489c-873d-049b5fab1716 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] 10.222.0.60 "GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.029172 Dec 15 13:32:05.135145 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 113/218] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Dec 15 13:32:05 2021] GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2/os-volume_attachments => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 15 13:32:05.855358 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-62a3ce52-00af-4694-83a1-c1ac9896775e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1607182722", "imageRef": "cfccedbb-7169-47ec-9bae-d4829cba54e1", "flavorRef": "452", "networks": [{"uuid": "12997ed3-8144-436a-8d20-22135e6511e5"}]}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:32:05.934390 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.network.neutron [None req-62a3ce52-00af-4694-83a1-c1ac9896775e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] validate_networks() for [('12997ed3-8144-436a-8d20-22135e6511e5', None, None, None, None, None)] {{(pid=116941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:32:05.954799 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-9ead3142-b8e7-4d85-9bc3-e986dec1a51a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:32:05.955737 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-9ead3142-b8e7-4d85-9bc3-e986dec1a51a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:05.965210 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9ead3142-b8e7-4d85-9bc3-e986dec1a51a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:05.966459 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9ead3142-b8e7-4d85-9bc3-e986dec1a51a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:05.967807 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9ead3142-b8e7-4d85-9bc3-e986dec1a51a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:05.968394 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9ead3142-b8e7-4d85-9bc3-e986dec1a51a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:06.069437 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-9ead3142-b8e7-4d85-9bc3-e986dec1a51a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 21288 microversion: 2.20 time: 0.118445 Dec 15 13:32:06.070095 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 114/219] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:32:05 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 21288 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:32:06.075890 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-6508f1b2-6f8c-4686-9e7e-96c52ac08eda tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:32:06.076595 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-6508f1b2-6f8c-4686-9e7e-96c52ac08eda tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: d3c2da8c-7e29-48ac-9077-59bffb2c734b] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:06.089044 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6508f1b2-6f8c-4686-9e7e-96c52ac08eda tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:06.090008 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6508f1b2-6f8c-4686-9e7e-96c52ac08eda tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:06.091128 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6508f1b2-6f8c-4686-9e7e-96c52ac08eda tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:06.092702 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6508f1b2-6f8c-4686-9e7e-96c52ac08eda tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:06.393652 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-6508f1b2-6f8c-4686-9e7e-96c52ac08eda tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:32:06.404502 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-6508f1b2-6f8c-4686-9e7e-96c52ac08eda tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b" status: 200 len: 1522 microversion: 2.1 time: 0.333224 Dec 15 13:32:06.405766 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 115/220] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:32:06 2021] GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b => generated 1522 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:32:06.418908 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-2fbffafd-15a7-4fcc-b1f2-b3666efb6289 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:32:06.422603 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-2fbffafd-15a7-4fcc-b1f2-b3666efb6289 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:06.432155 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2fbffafd-15a7-4fcc-b1f2-b3666efb6289 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:06.432953 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2fbffafd-15a7-4fcc-b1f2-b3666efb6289 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:06.434078 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2fbffafd-15a7-4fcc-b1f2-b3666efb6289 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:06.434737 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2fbffafd-15a7-4fcc-b1f2-b3666efb6289 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:06.463100 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-62a3ce52-00af-4694-83a1-c1ac9896775e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Flavor limits 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:32:06.463528 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-62a3ce52-00af-4694-83a1-c1ac9896775e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Image limits 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:32:06.464003 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-62a3ce52-00af-4694-83a1-c1ac9896775e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Flavor pref 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:32:06.464409 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-62a3ce52-00af-4694-83a1-c1ac9896775e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Image pref 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:32:06.465074 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-62a3ce52-00af-4694-83a1-c1ac9896775e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:32:06.477207 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-62a3ce52-00af-4694-83a1-c1ac9896775e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:06.477998 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-62a3ce52-00af-4694-83a1-c1ac9896775e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:06.479134 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-62a3ce52-00af-4694-83a1-c1ac9896775e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:06.479972 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-62a3ce52-00af-4694-83a1-c1ac9896775e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:06.499710 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-62a3ce52-00af-4694-83a1-c1ac9896775e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Getting quotas for project 18c80dfcc63a49f7b54f89f08cd8842f. Resources: {'cores', 'instances', 'ram'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:32:06.503861 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-62a3ce52-00af-4694-83a1-c1ac9896775e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Getting quotas for user df94523ab7c545f2a17a2cafe936d2ed and project 18c80dfcc63a49f7b54f89f08cd8842f. Resources: {'cores', 'instances', 'ram'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:32:06.515835 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-62a3ce52-00af-4694-83a1-c1ac9896775e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Going to run 1 instances... {{(pid=116941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:32:06.518340 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-62a3ce52-00af-4694-83a1-c1ac9896775e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: c7690a69-d110-45d1-8a94-2c7c366bba36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cfccedbb-7169-47ec-9bae-d4829cba54e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:32:06.525938 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-2fbffafd-15a7-4fcc-b1f2-b3666efb6289 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 14 microversion: 2.1 time: 0.118855 Dec 15 13:32:06.526968 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 116/221] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:32:06 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:32:06.532115 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ef2cf372-232d-46ca-a640-2e975ec388a9 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:32:06.532881 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ef2cf372-232d-46ca-a640-2e975ec388a9 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] [instance: c3130b20-b0cc-484a-b6b4-b4719540a6a2] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:06.539376 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ef2cf372-232d-46ca-a640-2e975ec388a9 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:06.540002 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ef2cf372-232d-46ca-a640-2e975ec388a9 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:06.540940 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ef2cf372-232d-46ca-a640-2e975ec388a9 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:06.541525 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ef2cf372-232d-46ca-a640-2e975ec388a9 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:06.556980 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.wsgi [None req-ef2cf372-232d-46ca-a640-2e975ec388a9 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] HTTP exception thrown: Instance c3130b20-b0cc-484a-b6b4-b4719540a6a2 could not be found. Dec 15 13:32:06.557574 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ef2cf372-232d-46ca-a640-2e975ec388a9 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Returning 404 to user: Instance c3130b20-b0cc-484a-b6b4-b4719540a6a2 could not be found. {{(pid=116942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:32:06.558401 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ef2cf372-232d-46ca-a640-2e975ec388a9 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2" status: 404 len: 111 microversion: 2.1 time: 0.030130 Dec 15 13:32:06.558979 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 117/222] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Dec 15 13:32:06 2021] DELETE /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:32:06.567521 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-17c6c941-f72f-449a-b548-777939b11982 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:32:06.568131 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-17c6c941-f72f-449a-b548-777939b11982 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] [instance: c3130b20-b0cc-484a-b6b4-b4719540a6a2] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:06.573753 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-62a3ce52-00af-4694-83a1-c1ac9896775e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.727082 Dec 15 13:32:06.574610 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 106/223] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Dec 15 13:32:05 2021] POST /compute/v2.1/servers => generated 380 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 13:32:06.583917 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-17c6c941-f72f-449a-b548-777939b11982 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:06.584299 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-17c6c941-f72f-449a-b548-777939b11982 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:06.585088 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-17c6c941-f72f-449a-b548-777939b11982 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:06.585603 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-ac4d1473-a2e2-4e14-9f53-65de71e343c0 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:32:06.585876 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-17c6c941-f72f-449a-b548-777939b11982 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:06.586445 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-ac4d1473-a2e2-4e14-9f53-65de71e343c0 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: c7690a69-d110-45d1-8a94-2c7c366bba36] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:06.607100 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.wsgi [None req-17c6c941-f72f-449a-b548-777939b11982 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] HTTP exception thrown: Instance c3130b20-b0cc-484a-b6b4-b4719540a6a2 could not be found. Dec 15 13:32:06.607897 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-17c6c941-f72f-449a-b548-777939b11982 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] Returning 404 to user: Instance c3130b20-b0cc-484a-b6b4-b4719540a6a2 could not be found. {{(pid=116942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:32:06.609474 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-17c6c941-f72f-449a-b548-777939b11982 tempest-DeleteServersTestJSON-1556876551 tempest-DeleteServersTestJSON-1556876551-project] 10.222.0.60 "GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2" status: 404 len: 111 microversion: 2.1 time: 0.046323 Dec 15 13:32:06.610634 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 118/224] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:32:06 2021] GET /compute/v2.1/servers/c3130b20-b0cc-484a-b6b4-b4719540a6a2 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 15 13:32:06.677483 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-ac4d1473-a2e2-4e14-9f53-65de71e343c0 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:32:06.696260 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-ac4d1473-a2e2-4e14-9f53-65de71e343c0 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/c7690a69-d110-45d1-8a94-2c7c366bba36" status: 200 len: 1218 microversion: 2.1 time: 0.115210 Dec 15 13:32:06.696937 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 107/225] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:32:06 2021] GET /compute/v2.1/servers/c7690a69-d110-45d1-8a94-2c7c366bba36 => generated 1218 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:32:07.080660 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-92182f6c-e1f0-43fb-baeb-ea586d098ca2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:32:07.082581 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-92182f6c-e1f0-43fb-baeb-ea586d098ca2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:07.090445 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-92182f6c-e1f0-43fb-baeb-ea586d098ca2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:07.090942 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-92182f6c-e1f0-43fb-baeb-ea586d098ca2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:07.091815 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-92182f6c-e1f0-43fb-baeb-ea586d098ca2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:07.093059 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-92182f6c-e1f0-43fb-baeb-ea586d098ca2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:07.189296 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-92182f6c-e1f0-43fb-baeb-ea586d098ca2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 22777 microversion: 2.20 time: 0.112547 Dec 15 13:32:07.190644 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 119/226] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:32:07 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 22777 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:32:07.421925 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-5469b95c-6c3b-4944-bdb7-623e114700ee tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:32:07.423065 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-5469b95c-6c3b-4944-bdb7-623e114700ee tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: d3c2da8c-7e29-48ac-9077-59bffb2c734b] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:07.431649 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5469b95c-6c3b-4944-bdb7-623e114700ee tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:07.432755 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5469b95c-6c3b-4944-bdb7-623e114700ee tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:07.434348 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5469b95c-6c3b-4944-bdb7-623e114700ee tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:07.435306 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5469b95c-6c3b-4944-bdb7-623e114700ee tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:07.537621 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-99cc2e08-c0bb-4d69-99d0-49e6f869cd25 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:32:07.538821 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-99cc2e08-c0bb-4d69-99d0-49e6f869cd25 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:07.559348 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-99cc2e08-c0bb-4d69-99d0-49e6f869cd25 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:07.560024 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-99cc2e08-c0bb-4d69-99d0-49e6f869cd25 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:07.560973 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-99cc2e08-c0bb-4d69-99d0-49e6f869cd25 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:07.561558 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-99cc2e08-c0bb-4d69-99d0-49e6f869cd25 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:07.647906 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-5469b95c-6c3b-4944-bdb7-623e114700ee tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:32:07.654627 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-99cc2e08-c0bb-4d69-99d0-49e6f869cd25 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 3291 microversion: 2.1 time: 0.121289 Dec 15 13:32:07.655280 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 120/227] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:32:07 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 3291 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:32:07.667720 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-5469b95c-6c3b-4944-bdb7-623e114700ee tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b" status: 200 len: 1522 microversion: 2.1 time: 0.249546 Dec 15 13:32:07.668437 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 108/228] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:32:07 2021] GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:32:07.713798 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-2903cf12-360c-4fb1-a4c1-65769d107bde tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:32:07.714612 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-2903cf12-360c-4fb1-a4c1-65769d107bde tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: c7690a69-d110-45d1-8a94-2c7c366bba36] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:07.729770 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2903cf12-360c-4fb1-a4c1-65769d107bde tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:07.730810 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2903cf12-360c-4fb1-a4c1-65769d107bde tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:07.731856 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2903cf12-360c-4fb1-a4c1-65769d107bde tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:07.732566 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2903cf12-360c-4fb1-a4c1-65769d107bde tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:08.068607 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-2903cf12-360c-4fb1-a4c1-65769d107bde tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:32:08.077185 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-2903cf12-360c-4fb1-a4c1-65769d107bde tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/c7690a69-d110-45d1-8a94-2c7c366bba36" status: 200 len: 1278 microversion: 2.1 time: 0.366735 Dec 15 13:32:08.077757 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 121/229] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:32:07 2021] GET /compute/v2.1/servers/c7690a69-d110-45d1-8a94-2c7c366bba36 => generated 1278 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:32:08.201960 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-4e0640fe-e94c-4fac-8510-226e745cb8cd tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:32:08.203068 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-4e0640fe-e94c-4fac-8510-226e745cb8cd tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:08.210024 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4e0640fe-e94c-4fac-8510-226e745cb8cd tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:08.210802 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4e0640fe-e94c-4fac-8510-226e745cb8cd tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:08.211843 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4e0640fe-e94c-4fac-8510-226e745cb8cd tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:08.212465 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4e0640fe-e94c-4fac-8510-226e745cb8cd tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:08.324473 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-4e0640fe-e94c-4fac-8510-226e745cb8cd tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 23239 microversion: 2.20 time: 0.126531 Dec 15 13:32:08.325279 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 109/230] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:32:08 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 23239 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:32:08.668220 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-12831bf3-d4d5-4a3e-96c1-a0330f9a0da4 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:32:08.670264 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-12831bf3-d4d5-4a3e-96c1-a0330f9a0da4 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:08.679521 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-12831bf3-d4d5-4a3e-96c1-a0330f9a0da4 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:08.680414 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-12831bf3-d4d5-4a3e-96c1-a0330f9a0da4 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:08.681621 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-12831bf3-d4d5-4a3e-96c1-a0330f9a0da4 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:08.683313 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-12831bf3-d4d5-4a3e-96c1-a0330f9a0da4 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:08.696303 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-edfbc565-a0d9-4d96-a280-d226602b83d7 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:32:08.697484 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-edfbc565-a0d9-4d96-a280-d226602b83d7 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: d3c2da8c-7e29-48ac-9077-59bffb2c734b] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:08.704962 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-edfbc565-a0d9-4d96-a280-d226602b83d7 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:08.705637 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-edfbc565-a0d9-4d96-a280-d226602b83d7 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:08.706595 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-edfbc565-a0d9-4d96-a280-d226602b83d7 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:08.707265 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-edfbc565-a0d9-4d96-a280-d226602b83d7 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:08.815552 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-12831bf3-d4d5-4a3e-96c1-a0330f9a0da4 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 9366 microversion: 2.1 time: 0.153349 Dec 15 13:32:08.817008 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 122/231] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:32:08 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 9366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:32:08.841616 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-edfbc565-a0d9-4d96-a280-d226602b83d7 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:32:08.849395 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-edfbc565-a0d9-4d96-a280-d226602b83d7 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b" status: 200 len: 1522 microversion: 2.1 time: 0.166906 Dec 15 13:32:08.850008 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 110/232] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:32:08 2021] GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:32:08.940544 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-60a06481-67c6-4d97-8040-3d5282495d04 tempest-VolumesGetTestJSON-1375002216 tempest-VolumesGetTestJSON-1375002216-project] Action: 'create', calling method: .version_select at 0x7ff51406fd30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1791930654", "metadata": {"Type": "work"}}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:32:09.095130 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-2a9518ab-ecd8-4161-9b49-f431ca82b2d5 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:32:09.096021 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-2a9518ab-ecd8-4161-9b49-f431ca82b2d5 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: c7690a69-d110-45d1-8a94-2c7c366bba36] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:09.103866 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2a9518ab-ecd8-4161-9b49-f431ca82b2d5 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:09.104554 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2a9518ab-ecd8-4161-9b49-f431ca82b2d5 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:09.105320 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2a9518ab-ecd8-4161-9b49-f431ca82b2d5 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:09.105734 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2a9518ab-ecd8-4161-9b49-f431ca82b2d5 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:09.274582 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-2a9518ab-ecd8-4161-9b49-f431ca82b2d5 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:32:09.287883 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-2a9518ab-ecd8-4161-9b49-f431ca82b2d5 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/c7690a69-d110-45d1-8a94-2c7c366bba36" status: 200 len: 1318 microversion: 2.1 time: 0.196120 Dec 15 13:32:09.289088 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 111/233] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:32:09 2021] GET /compute/v2.1/servers/c7690a69-d110-45d1-8a94-2c7c366bba36 => generated 1318 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:32:09.294374 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-cc4ddfac-00dd-4408-91d1-7f8d3520ffee req-dabf7faf-9012-4fc2-b783-971ca004a918 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7690a69-d110-45d1-8a94-2c7c366bba36", "tag": "92df63b2-2815-4499-b41a-e23801cf68f8"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:32:09.296061 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:32:09.296061 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: warnings.warn(msg) Dec 15 13:32:09.300323 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-60a06481-67c6-4d97-8040-3d5282495d04 tempest-VolumesGetTestJSON-1375002216 tempest-VolumesGetTestJSON-1375002216-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.481654 Dec 15 13:32:09.301730 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 123/234] 10.222.0.60 () {60 vars in 1155 bytes} [Wed Dec 15 13:32:08 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 484 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Dec 15 13:32:09.306139 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-cc4ddfac-00dd-4408-91d1-7f8d3520ffee req-dabf7faf-9012-4fc2-b783-971ca004a918 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:09.306581 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-cc4ddfac-00dd-4408-91d1-7f8d3520ffee req-dabf7faf-9012-4fc2-b783-971ca004a918 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:09.312208 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-832a9a6f-ff4d-4cad-9717-250f82127d29 tempest-VolumesGetTestJSON-1375002216 tempest-VolumesGetTestJSON-1375002216-project] Calling method '.version_select at 0x7ff50fe50dc0>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:32:09.319609 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-cc4ddfac-00dd-4408-91d1-7f8d3520ffee req-dabf7faf-9012-4fc2-b783-971ca004a918 service nova] Creating event network-changed:92df63b2-2815-4499-b41a-e23801cf68f8 for instance c7690a69-d110-45d1-8a94-2c7c366bba36 on hv-cinder-81322 Dec 15 13:32:09.324783 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-cc4ddfac-00dd-4408-91d1-7f8d3520ffee req-dabf7faf-9012-4fc2-b783-971ca004a918 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034430 Dec 15 13:32:09.325378 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 112/235] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:32:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:32:09.336911 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-a9002916-15fb-4e1b-ae5e-3e832e21ab6d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:32:09.337958 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-a9002916-15fb-4e1b-ae5e-3e832e21ab6d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:09.344181 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a9002916-15fb-4e1b-ae5e-3e832e21ab6d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:09.344631 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a9002916-15fb-4e1b-ae5e-3e832e21ab6d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:09.345447 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a9002916-15fb-4e1b-ae5e-3e832e21ab6d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:09.345882 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a9002916-15fb-4e1b-ae5e-3e832e21ab6d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:09.365098 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-832a9a6f-ff4d-4cad-9717-250f82127d29 tempest-VolumesGetTestJSON-1375002216 tempest-VolumesGetTestJSON-1375002216-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/17c205d9-5b7f-4f1c-92dc-69a962c6338b" status: 200 len: 353 microversion: 2.1 time: 0.056078 Dec 15 13:32:09.365791 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 124/236] 10.222.0.60 () {58 vars in 1244 bytes} [Wed Dec 15 13:32:09 2021] GET /compute/v2.1/os-volumes/17c205d9-5b7f-4f1c-92dc-69a962c6338b => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:32:09.462141 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-a9002916-15fb-4e1b-ae5e-3e832e21ab6d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 24270 microversion: 2.20 time: 0.130066 Dec 15 13:32:09.462891 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 113/237] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:32:09 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 24270 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:32:09.827144 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-78b531cc-02f5-4322-a695-b799ebb5d749 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:32:09.828182 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-78b531cc-02f5-4322-a695-b799ebb5d749 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:09.835712 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-78b531cc-02f5-4322-a695-b799ebb5d749 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:09.836166 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-78b531cc-02f5-4322-a695-b799ebb5d749 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:09.836939 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-78b531cc-02f5-4322-a695-b799ebb5d749 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:09.837378 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-78b531cc-02f5-4322-a695-b799ebb5d749 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:09.865751 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-c3dc1faa-dbea-43ce-afe3-ad831c4eb9e7 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:32:09.866547 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-c3dc1faa-dbea-43ce-afe3-ad831c4eb9e7 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: d3c2da8c-7e29-48ac-9077-59bffb2c734b] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:09.873642 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c3dc1faa-dbea-43ce-afe3-ad831c4eb9e7 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:09.874093 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c3dc1faa-dbea-43ce-afe3-ad831c4eb9e7 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:09.874903 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c3dc1faa-dbea-43ce-afe3-ad831c4eb9e7 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:09.875343 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c3dc1faa-dbea-43ce-afe3-ad831c4eb9e7 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:10.010899 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-c3dc1faa-dbea-43ce-afe3-ad831c4eb9e7 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:32:10.018247 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-c3dc1faa-dbea-43ce-afe3-ad831c4eb9e7 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b" status: 200 len: 1522 microversion: 2.1 time: 0.156461 Dec 15 13:32:10.024713 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 114/238] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:32:09 2021] GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:32:10.109808 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-78b531cc-02f5-4322-a695-b799ebb5d749 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 15025 microversion: 2.1 time: 0.286130 Dec 15 13:32:10.111056 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 125/239] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:32:09 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 15025 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:32:10.305515 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-3d209a27-ebe4-4e34-91b1-606886034fb1 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:32:10.306065 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-3d209a27-ebe4-4e34-91b1-606886034fb1 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: c7690a69-d110-45d1-8a94-2c7c366bba36] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:10.313105 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3d209a27-ebe4-4e34-91b1-606886034fb1 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:10.313552 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3d209a27-ebe4-4e34-91b1-606886034fb1 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:10.314335 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3d209a27-ebe4-4e34-91b1-606886034fb1 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:10.314812 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3d209a27-ebe4-4e34-91b1-606886034fb1 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:10.377798 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-edc4d124-0ff9-4c94-9103-9e257c9955f7 tempest-VolumesGetTestJSON-1375002216 tempest-VolumesGetTestJSON-1375002216-project] Calling method '.version_select at 0x7ff50ff73b80>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:32:10.427661 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-edc4d124-0ff9-4c94-9103-9e257c9955f7 tempest-VolumesGetTestJSON-1375002216 tempest-VolumesGetTestJSON-1375002216-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/17c205d9-5b7f-4f1c-92dc-69a962c6338b" status: 200 len: 354 microversion: 2.1 time: 0.053776 Dec 15 13:32:10.428494 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 126/240] 10.222.0.60 () {58 vars in 1244 bytes} [Wed Dec 15 13:32:10 2021] GET /compute/v2.1/os-volumes/17c205d9-5b7f-4f1c-92dc-69a962c6338b => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:32:10.438591 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-f3d8e7bd-2c03-4092-8224-4c4a9556ee99 tempest-VolumesGetTestJSON-1375002216 tempest-VolumesGetTestJSON-1375002216-project] Calling method '.version_select at 0x7ff50ff28ee0>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:32:10.449310 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-3d209a27-ebe4-4e34-91b1-606886034fb1 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:32:10.457606 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-3d209a27-ebe4-4e34-91b1-606886034fb1 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/c7690a69-d110-45d1-8a94-2c7c366bba36" status: 200 len: 1318 microversion: 2.1 time: 0.155787 Dec 15 13:32:10.458670 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 115/241] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:32:10 2021] GET /compute/v2.1/servers/c7690a69-d110-45d1-8a94-2c7c366bba36 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:32:10.474385 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-fb73a64f-bd38-4a9c-bb82-8bef8a726c5a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:32:10.475447 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-fb73a64f-bd38-4a9c-bb82-8bef8a726c5a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:10.482287 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-fb73a64f-bd38-4a9c-bb82-8bef8a726c5a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:10.482732 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-fb73a64f-bd38-4a9c-bb82-8bef8a726c5a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:10.483557 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-fb73a64f-bd38-4a9c-bb82-8bef8a726c5a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:10.483985 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-fb73a64f-bd38-4a9c-bb82-8bef8a726c5a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:10.624832 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-f3d8e7bd-2c03-4092-8224-4c4a9556ee99 tempest-VolumesGetTestJSON-1375002216 tempest-VolumesGetTestJSON-1375002216-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/17c205d9-5b7f-4f1c-92dc-69a962c6338b" status: 200 len: 354 microversion: 2.1 time: 0.189667 Dec 15 13:32:10.625554 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 127/242] 10.222.0.60 () {58 vars in 1244 bytes} [Wed Dec 15 13:32:10 2021] GET /compute/v2.1/os-volumes/17c205d9-5b7f-4f1c-92dc-69a962c6338b => generated 354 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:32:10.642203 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ec378dc1-ba64-499a-92d0-ff9773cc936e tempest-VolumesGetTestJSON-1375002216 tempest-VolumesGetTestJSON-1375002216-project] Calling method '.version_select at 0x7ff50ff29a60>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:32:10.690056 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-fb73a64f-bd38-4a9c-bb82-8bef8a726c5a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 24974 microversion: 2.20 time: 0.219912 Dec 15 13:32:10.691130 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 116/243] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:32:10 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 24974 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:32:10.701965 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ec378dc1-ba64-499a-92d0-ff9773cc936e tempest-VolumesGetTestJSON-1375002216 tempest-VolumesGetTestJSON-1375002216-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/17c205d9-5b7f-4f1c-92dc-69a962c6338b" status: 202 len: 0 microversion: 2.1 time: 0.064357 Dec 15 13:32:10.702596 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 128/244] 10.222.0.60 () {58 vars in 1247 bytes} [Wed Dec 15 13:32:10 2021] DELETE /compute/v2.1/os-volumes/17c205d9-5b7f-4f1c-92dc-69a962c6338b => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:32:10.711665 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-b0b1baf9-24f0-4849-a626-f14c031aada8 tempest-VolumesGetTestJSON-1375002216 tempest-VolumesGetTestJSON-1375002216-project] Calling method '.version_select at 0x7ff50f79f040>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:32:10.759018 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-b0b1baf9-24f0-4849-a626-f14c031aada8 tempest-VolumesGetTestJSON-1375002216 tempest-VolumesGetTestJSON-1375002216-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/17c205d9-5b7f-4f1c-92dc-69a962c6338b" status: 200 len: 353 microversion: 2.1 time: 0.051720 Dec 15 13:32:10.759692 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 117/245] 10.222.0.60 () {58 vars in 1244 bytes} [Wed Dec 15 13:32:10 2021] GET /compute/v2.1/os-volumes/17c205d9-5b7f-4f1c-92dc-69a962c6338b => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:32:11.036733 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-c9c6b9bb-9dcf-4eed-b194-ff4fa140badc tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:32:11.039229 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-c9c6b9bb-9dcf-4eed-b194-ff4fa140badc tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: d3c2da8c-7e29-48ac-9077-59bffb2c734b] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:11.046574 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c9c6b9bb-9dcf-4eed-b194-ff4fa140badc tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:11.047088 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c9c6b9bb-9dcf-4eed-b194-ff4fa140badc tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:11.047891 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c9c6b9bb-9dcf-4eed-b194-ff4fa140badc tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:11.048333 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c9c6b9bb-9dcf-4eed-b194-ff4fa140badc tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:11.122634 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-55bf887f-6203-460d-b6ac-292f3ea70fde tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:32:11.123822 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-55bf887f-6203-460d-b6ac-292f3ea70fde tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:11.129805 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-55bf887f-6203-460d-b6ac-292f3ea70fde tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:11.130256 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-55bf887f-6203-460d-b6ac-292f3ea70fde tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:11.132337 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-55bf887f-6203-460d-b6ac-292f3ea70fde tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:11.132337 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-55bf887f-6203-460d-b6ac-292f3ea70fde tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:11.181254 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-c9c6b9bb-9dcf-4eed-b194-ff4fa140badc tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:32:11.188488 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-c9c6b9bb-9dcf-4eed-b194-ff4fa140badc tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b" status: 200 len: 1522 microversion: 2.1 time: 0.157213 Dec 15 13:32:11.189065 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 129/246] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:32:11 2021] GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:32:11.226792 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-55bf887f-6203-460d-b6ac-292f3ea70fde tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 16616 microversion: 2.1 time: 0.108835 Dec 15 13:32:11.227660 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 118/247] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:32:11 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 16616 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:32:11.475515 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-0c575c7d-b5cb-4709-9dad-c04140dd5d28 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:32:11.476199 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-0c575c7d-b5cb-4709-9dad-c04140dd5d28 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: c7690a69-d110-45d1-8a94-2c7c366bba36] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:11.482462 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0c575c7d-b5cb-4709-9dad-c04140dd5d28 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:11.482942 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0c575c7d-b5cb-4709-9dad-c04140dd5d28 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:11.483726 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0c575c7d-b5cb-4709-9dad-c04140dd5d28 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:11.484164 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0c575c7d-b5cb-4709-9dad-c04140dd5d28 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:11.665300 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-0c575c7d-b5cb-4709-9dad-c04140dd5d28 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:32:11.672544 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-0c575c7d-b5cb-4709-9dad-c04140dd5d28 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/c7690a69-d110-45d1-8a94-2c7c366bba36" status: 200 len: 1318 microversion: 2.1 time: 0.200744 Dec 15 13:32:11.673113 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 130/248] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:32:11 2021] GET /compute/v2.1/servers/c7690a69-d110-45d1-8a94-2c7c366bba36 => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:32:11.702275 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-8288ee25-725e-4bd8-8f54-788b0ba843a5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:32:11.702818 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-8288ee25-725e-4bd8-8f54-788b0ba843a5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:11.710196 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8288ee25-725e-4bd8-8f54-788b0ba843a5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:11.710696 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8288ee25-725e-4bd8-8f54-788b0ba843a5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:11.711450 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8288ee25-725e-4bd8-8f54-788b0ba843a5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:11.711887 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8288ee25-725e-4bd8-8f54-788b0ba843a5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:11.772089 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-5b051054-5ac6-4da0-a31a-45eba7e8407a tempest-VolumesGetTestJSON-1375002216 tempest-VolumesGetTestJSON-1375002216-project] Calling method '.version_select at 0x7ff50ff281f0>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:32:11.800983 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.wsgi [None req-5b051054-5ac6-4da0-a31a-45eba7e8407a tempest-VolumesGetTestJSON-1375002216 tempest-VolumesGetTestJSON-1375002216-project] HTTP exception thrown: Volume 17c205d9-5b7f-4f1c-92dc-69a962c6338b could not be found. Dec 15 13:32:11.801594 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-5b051054-5ac6-4da0-a31a-45eba7e8407a tempest-VolumesGetTestJSON-1375002216 tempest-VolumesGetTestJSON-1375002216-project] Returning 404 to user: Volume 17c205d9-5b7f-4f1c-92dc-69a962c6338b could not be found. {{(pid=116942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:32:11.802438 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-5b051054-5ac6-4da0-a31a-45eba7e8407a tempest-VolumesGetTestJSON-1375002216 tempest-VolumesGetTestJSON-1375002216-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/17c205d9-5b7f-4f1c-92dc-69a962c6338b" status: 404 len: 109 microversion: 2.1 time: 0.034663 Dec 15 13:32:11.803015 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 131/249] 10.222.0.60 () {58 vars in 1244 bytes} [Wed Dec 15 13:32:11 2021] GET /compute/v2.1/os-volumes/17c205d9-5b7f-4f1c-92dc-69a962c6338b => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 15 13:32:11.814291 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-8288ee25-725e-4bd8-8f54-788b0ba843a5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 25739 microversion: 2.20 time: 0.116241 Dec 15 13:32:11.815273 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 119/250] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:32:11 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 25739 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:32:12.206112 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-523a88fb-8f13-41ed-b18d-81d57b0bad5e tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:32:12.207479 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-523a88fb-8f13-41ed-b18d-81d57b0bad5e tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: d3c2da8c-7e29-48ac-9077-59bffb2c734b] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:12.214514 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-523a88fb-8f13-41ed-b18d-81d57b0bad5e tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:12.215253 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-523a88fb-8f13-41ed-b18d-81d57b0bad5e tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:12.216398 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-523a88fb-8f13-41ed-b18d-81d57b0bad5e tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:12.217036 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-523a88fb-8f13-41ed-b18d-81d57b0bad5e tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:12.238683 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-dd2b742b-4ed2-47a2-b7ed-c9cb84026848 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:32:12.240281 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-dd2b742b-4ed2-47a2-b7ed-c9cb84026848 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:12.258623 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-dd2b742b-4ed2-47a2-b7ed-c9cb84026848 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:12.259135 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-dd2b742b-4ed2-47a2-b7ed-c9cb84026848 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:12.259924 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-dd2b742b-4ed2-47a2-b7ed-c9cb84026848 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:12.260366 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-dd2b742b-4ed2-47a2-b7ed-c9cb84026848 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:12.399672 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-dd2b742b-4ed2-47a2-b7ed-c9cb84026848 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 17960 microversion: 2.1 time: 0.165149 Dec 15 13:32:12.400553 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 120/251] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:32:12 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 17960 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:32:12.529567 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-523a88fb-8f13-41ed-b18d-81d57b0bad5e tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:32:12.537772 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-523a88fb-8f13-41ed-b18d-81d57b0bad5e tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b" status: 200 len: 1522 microversion: 2.1 time: 0.336921 Dec 15 13:32:12.538374 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 132/252] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:32:12 2021] GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b => generated 1522 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:32:12.697455 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-fcd63e19-ce30-4d3e-8d41-935b69764fe3 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:32:12.698383 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-fcd63e19-ce30-4d3e-8d41-935b69764fe3 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: c7690a69-d110-45d1-8a94-2c7c366bba36] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:12.707318 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-fcd63e19-ce30-4d3e-8d41-935b69764fe3 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:12.708024 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-fcd63e19-ce30-4d3e-8d41-935b69764fe3 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:12.709008 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-fcd63e19-ce30-4d3e-8d41-935b69764fe3 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:12.709929 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-fcd63e19-ce30-4d3e-8d41-935b69764fe3 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:12.827275 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-49ece764-602e-48d8-840e-f2b49abc9dfd tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:32:12.828620 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-49ece764-602e-48d8-840e-f2b49abc9dfd tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:12.838211 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-49ece764-602e-48d8-840e-f2b49abc9dfd tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:12.838785 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-49ece764-602e-48d8-840e-f2b49abc9dfd tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:12.840706 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-49ece764-602e-48d8-840e-f2b49abc9dfd tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:12.841631 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-49ece764-602e-48d8-840e-f2b49abc9dfd tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:12.948361 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-fcd63e19-ce30-4d3e-8d41-935b69764fe3 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:32:12.963192 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-49ece764-602e-48d8-840e-f2b49abc9dfd tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 26484 microversion: 2.20 time: 0.139609 Dec 15 13:32:12.963356 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-fcd63e19-ce30-4d3e-8d41-935b69764fe3 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/c7690a69-d110-45d1-8a94-2c7c366bba36" status: 200 len: 1318 microversion: 2.1 time: 0.276819 Dec 15 13:32:12.971266 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 121/253] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:32:12 2021] GET /compute/v2.1/servers/c7690a69-d110-45d1-8a94-2c7c366bba36 => generated 1318 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:32:12.972080 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 133/254] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:32:12 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 26484 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:32:13.411651 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-407e1e8b-c751-43d6-b7db-ea1ad573bfdb tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:32:13.412542 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-407e1e8b-c751-43d6-b7db-ea1ad573bfdb tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:13.424683 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-407e1e8b-c751-43d6-b7db-ea1ad573bfdb tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:13.425439 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-407e1e8b-c751-43d6-b7db-ea1ad573bfdb tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:13.426224 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-407e1e8b-c751-43d6-b7db-ea1ad573bfdb tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:13.426650 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-407e1e8b-c751-43d6-b7db-ea1ad573bfdb tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:13.535507 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-407e1e8b-c751-43d6-b7db-ea1ad573bfdb tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 18977 microversion: 2.1 time: 0.126877 Dec 15 13:32:13.536198 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 122/255] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:32:13 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 18977 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:32:13.555621 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-b46645d1-3da0-4177-82ee-ef0c2597a5ec tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:32:13.556319 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-b46645d1-3da0-4177-82ee-ef0c2597a5ec tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: d3c2da8c-7e29-48ac-9077-59bffb2c734b] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:13.563110 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b46645d1-3da0-4177-82ee-ef0c2597a5ec tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:13.563780 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b46645d1-3da0-4177-82ee-ef0c2597a5ec tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:13.564582 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b46645d1-3da0-4177-82ee-ef0c2597a5ec tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:13.565025 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b46645d1-3da0-4177-82ee-ef0c2597a5ec tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:13.724702 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-b46645d1-3da0-4177-82ee-ef0c2597a5ec tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:32:13.732120 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-b46645d1-3da0-4177-82ee-ef0c2597a5ec tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b" status: 200 len: 1522 microversion: 2.1 time: 0.180432 Dec 15 13:32:13.732698 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 134/256] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:32:13 2021] GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:32:13.980240 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-8003b2a2-7156-4b4d-9a6e-4623e26eb19d tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:32:13.981327 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-8003b2a2-7156-4b4d-9a6e-4623e26eb19d tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: c7690a69-d110-45d1-8a94-2c7c366bba36] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:13.985073 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-9c4e0fcc-ac80-4be7-a6c7-a19e9ebeca5a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:32:13.986132 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-9c4e0fcc-ac80-4be7-a6c7-a19e9ebeca5a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:13.988976 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8003b2a2-7156-4b4d-9a6e-4623e26eb19d tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:13.989799 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8003b2a2-7156-4b4d-9a6e-4623e26eb19d tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:13.990780 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8003b2a2-7156-4b4d-9a6e-4623e26eb19d tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:13.991469 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8003b2a2-7156-4b4d-9a6e-4623e26eb19d tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:14.000742 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9c4e0fcc-ac80-4be7-a6c7-a19e9ebeca5a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:14.002477 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9c4e0fcc-ac80-4be7-a6c7-a19e9ebeca5a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:14.003649 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9c4e0fcc-ac80-4be7-a6c7-a19e9ebeca5a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:14.004346 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9c4e0fcc-ac80-4be7-a6c7-a19e9ebeca5a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:14.119660 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-9c4e0fcc-ac80-4be7-a6c7-a19e9ebeca5a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 27051 microversion: 2.20 time: 0.139657 Dec 15 13:32:14.120586 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 135/257] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:32:13 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 27051 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:32:14.214766 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-8003b2a2-7156-4b4d-9a6e-4623e26eb19d tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:32:14.226435 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-8003b2a2-7156-4b4d-9a6e-4623e26eb19d tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/c7690a69-d110-45d1-8a94-2c7c366bba36" status: 200 len: 1318 microversion: 2.1 time: 0.250517 Dec 15 13:32:14.227591 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 123/258] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:32:13 2021] GET /compute/v2.1/servers/c7690a69-d110-45d1-8a94-2c7c366bba36 => generated 1318 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:32:14.548632 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-6c7cd1a6-9b63-46d0-87cb-75b70f3ff68d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:32:14.549924 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-6c7cd1a6-9b63-46d0-87cb-75b70f3ff68d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:14.562829 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6c7cd1a6-9b63-46d0-87cb-75b70f3ff68d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:14.571054 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6c7cd1a6-9b63-46d0-87cb-75b70f3ff68d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:14.571054 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6c7cd1a6-9b63-46d0-87cb-75b70f3ff68d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:14.571054 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6c7cd1a6-9b63-46d0-87cb-75b70f3ff68d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:14.754204 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-6c7cd1a6-9b63-46d0-87cb-75b70f3ff68d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 20997 microversion: 2.1 time: 0.206436 Dec 15 13:32:14.756227 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 136/259] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:32:14 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 20997 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:32:14.757804 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-56333257-6156-4321-a395-52aa64722ee2 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:32:14.758439 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-56333257-6156-4321-a395-52aa64722ee2 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: d3c2da8c-7e29-48ac-9077-59bffb2c734b] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:14.765637 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-56333257-6156-4321-a395-52aa64722ee2 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:14.766108 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-56333257-6156-4321-a395-52aa64722ee2 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:14.767121 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-56333257-6156-4321-a395-52aa64722ee2 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:14.767749 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-56333257-6156-4321-a395-52aa64722ee2 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:14.950419 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-56333257-6156-4321-a395-52aa64722ee2 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:32:14.960378 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-56333257-6156-4321-a395-52aa64722ee2 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b" status: 200 len: 1522 microversion: 2.1 time: 0.214110 Dec 15 13:32:14.960961 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 124/260] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:32:14 2021] GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:32:15.134619 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-55db62f5-d904-4a67-a84a-8a6c25eed396 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:32:15.135556 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-55db62f5-d904-4a67-a84a-8a6c25eed396 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:15.161281 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-55db62f5-d904-4a67-a84a-8a6c25eed396 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:15.162064 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-55db62f5-d904-4a67-a84a-8a6c25eed396 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:15.164342 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-55db62f5-d904-4a67-a84a-8a6c25eed396 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:15.165276 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-55db62f5-d904-4a67-a84a-8a6c25eed396 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:15.244549 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-8d38fcbe-8ad4-4579-9d16-47d15afd4339 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:32:15.245257 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-8d38fcbe-8ad4-4579-9d16-47d15afd4339 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: c7690a69-d110-45d1-8a94-2c7c366bba36] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:15.251832 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8d38fcbe-8ad4-4579-9d16-47d15afd4339 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:15.252355 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8d38fcbe-8ad4-4579-9d16-47d15afd4339 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:15.253241 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8d38fcbe-8ad4-4579-9d16-47d15afd4339 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:15.253883 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8d38fcbe-8ad4-4579-9d16-47d15afd4339 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:15.278132 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-55db62f5-d904-4a67-a84a-8a6c25eed396 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 27558 microversion: 2.20 time: 0.148777 Dec 15 13:32:15.280919 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 137/261] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:32:15 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 27558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:32:15.407035 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-8d38fcbe-8ad4-4579-9d16-47d15afd4339 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:32:15.415976 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-8d38fcbe-8ad4-4579-9d16-47d15afd4339 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/c7690a69-d110-45d1-8a94-2c7c366bba36" status: 200 len: 1318 microversion: 2.1 time: 0.175261 Dec 15 13:32:15.417036 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 125/262] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:32:15 2021] GET /compute/v2.1/servers/c7690a69-d110-45d1-8a94-2c7c366bba36 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:32:15.766872 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-dd819fa3-7ced-4102-8f0b-e2cb2aaf99c7 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:32:15.768346 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-dd819fa3-7ced-4102-8f0b-e2cb2aaf99c7 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:15.777862 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-dd819fa3-7ced-4102-8f0b-e2cb2aaf99c7 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:15.778412 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-dd819fa3-7ced-4102-8f0b-e2cb2aaf99c7 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:15.779388 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-dd819fa3-7ced-4102-8f0b-e2cb2aaf99c7 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:15.779837 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-dd819fa3-7ced-4102-8f0b-e2cb2aaf99c7 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:15.943757 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-dd819fa3-7ced-4102-8f0b-e2cb2aaf99c7 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 22715 microversion: 2.1 time: 0.180411 Dec 15 13:32:15.945641 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 138/263] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:32:15 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 22715 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:32:15.979084 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-cc1a1502-4bcc-49cc-b0bc-d44bdd6bac94 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:32:15.979706 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-cc1a1502-4bcc-49cc-b0bc-d44bdd6bac94 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: d3c2da8c-7e29-48ac-9077-59bffb2c734b] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:15.987738 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cc1a1502-4bcc-49cc-b0bc-d44bdd6bac94 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:15.988422 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cc1a1502-4bcc-49cc-b0bc-d44bdd6bac94 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:15.990319 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cc1a1502-4bcc-49cc-b0bc-d44bdd6bac94 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:15.990971 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cc1a1502-4bcc-49cc-b0bc-d44bdd6bac94 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:16.148082 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-cc1a1502-4bcc-49cc-b0bc-d44bdd6bac94 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:32:16.155581 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-cc1a1502-4bcc-49cc-b0bc-d44bdd6bac94 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b" status: 200 len: 1522 microversion: 2.1 time: 0.182600 Dec 15 13:32:16.156728 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 126/264] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:32:15 2021] GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:32:16.292115 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-372bbbf2-e4fd-4913-966b-e0e0357189d8 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:32:16.293341 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-372bbbf2-e4fd-4913-966b-e0e0357189d8 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:16.301144 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-372bbbf2-e4fd-4913-966b-e0e0357189d8 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:16.301588 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-372bbbf2-e4fd-4913-966b-e0e0357189d8 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:16.302380 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-372bbbf2-e4fd-4913-966b-e0e0357189d8 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:16.302812 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-372bbbf2-e4fd-4913-966b-e0e0357189d8 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:16.407266 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-372bbbf2-e4fd-4913-966b-e0e0357189d8 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 27690 microversion: 2.20 time: 0.118966 Dec 15 13:32:16.411900 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 139/265] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:32:16 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 27690 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:32:16.437939 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-584dc992-5d89-4823-8378-435fd4b3274c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:32:16.439139 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-584dc992-5d89-4823-8378-435fd4b3274c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: c7690a69-d110-45d1-8a94-2c7c366bba36] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:16.460593 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-584dc992-5d89-4823-8378-435fd4b3274c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:16.461048 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-584dc992-5d89-4823-8378-435fd4b3274c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:16.465161 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-584dc992-5d89-4823-8378-435fd4b3274c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:16.465827 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-584dc992-5d89-4823-8378-435fd4b3274c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:16.672471 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-584dc992-5d89-4823-8378-435fd4b3274c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:32:16.691778 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-584dc992-5d89-4823-8378-435fd4b3274c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/c7690a69-d110-45d1-8a94-2c7c366bba36" status: 200 len: 1318 microversion: 2.1 time: 0.260980 Dec 15 13:32:16.693041 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 127/266] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:32:16 2021] GET /compute/v2.1/servers/c7690a69-d110-45d1-8a94-2c7c366bba36 => generated 1318 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:32:16.956869 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-57338174-c79d-48b9-99ad-1eeb8b7b0547 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:32:16.958565 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-57338174-c79d-48b9-99ad-1eeb8b7b0547 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:16.965910 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-57338174-c79d-48b9-99ad-1eeb8b7b0547 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:16.966677 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-57338174-c79d-48b9-99ad-1eeb8b7b0547 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:16.968778 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-57338174-c79d-48b9-99ad-1eeb8b7b0547 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:16.969420 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-57338174-c79d-48b9-99ad-1eeb8b7b0547 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:17.172846 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-305e150f-078d-4ff4-80f7-5c492fdbb0fa tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:32:17.174147 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-305e150f-078d-4ff4-80f7-5c492fdbb0fa tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: d3c2da8c-7e29-48ac-9077-59bffb2c734b] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:17.180728 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-305e150f-078d-4ff4-80f7-5c492fdbb0fa tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:17.181183 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-305e150f-078d-4ff4-80f7-5c492fdbb0fa tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:17.181980 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-305e150f-078d-4ff4-80f7-5c492fdbb0fa tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:17.182419 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-305e150f-078d-4ff4-80f7-5c492fdbb0fa tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:17.364986 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-305e150f-078d-4ff4-80f7-5c492fdbb0fa tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:32:17.372708 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-305e150f-078d-4ff4-80f7-5c492fdbb0fa tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b" status: 200 len: 1522 microversion: 2.1 time: 0.203382 Dec 15 13:32:17.383879 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 128/267] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:32:17 2021] GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:32:17.419084 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-f03cc80f-0c8a-46c0-b6ef-3e20a6b767b4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:32:17.420340 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-f03cc80f-0c8a-46c0-b6ef-3e20a6b767b4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:17.427479 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f03cc80f-0c8a-46c0-b6ef-3e20a6b767b4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:17.427934 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f03cc80f-0c8a-46c0-b6ef-3e20a6b767b4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:17.428731 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f03cc80f-0c8a-46c0-b6ef-3e20a6b767b4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:17.429163 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f03cc80f-0c8a-46c0-b6ef-3e20a6b767b4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:20.652596 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-57338174-c79d-48b9-99ad-1eeb8b7b0547 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 25737 microversion: 2.1 time: 3.699615 Dec 15 13:32:20.653262 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 140/268] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:32:16 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 25737 bytes in 3702 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:32:20.672485 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-39def2e1-e7a1-42fb-b8a1-f0d45b15bb45 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:32:20.674657 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-39def2e1-e7a1-42fb-b8a1-f0d45b15bb45 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: c7690a69-d110-45d1-8a94-2c7c366bba36] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:20.681752 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-39def2e1-e7a1-42fb-b8a1-f0d45b15bb45 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:20.682505 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-39def2e1-e7a1-42fb-b8a1-f0d45b15bb45 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:20.683592 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-39def2e1-e7a1-42fb-b8a1-f0d45b15bb45 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:20.684242 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-39def2e1-e7a1-42fb-b8a1-f0d45b15bb45 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:20.751347 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-f03cc80f-0c8a-46c0-b6ef-3e20a6b767b4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 27985 microversion: 2.20 time: 3.335646 Dec 15 13:32:20.757805 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 129/269] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:32:17 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 27985 bytes in 3343 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:32:20.764111 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-f81c51d2-2091-4677-b280-9edda0b0cae5 req-f2bc9165-1c50-4059-9db9-3fbccacc17be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7690a69-d110-45d1-8a94-2c7c366bba36", "name": "network-vif-plugged", "status": "completed", "tag": "92df63b2-2815-4499-b41a-e23801cf68f8"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:32:20.765966 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:32:20.765966 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: warnings.warn(msg) Dec 15 13:32:20.786041 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-f81c51d2-2091-4677-b280-9edda0b0cae5 req-f2bc9165-1c50-4059-9db9-3fbccacc17be service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:20.786760 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-f81c51d2-2091-4677-b280-9edda0b0cae5 req-f2bc9165-1c50-4059-9db9-3fbccacc17be service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:20.800899 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-f81c51d2-2091-4677-b280-9edda0b0cae5 req-f2bc9165-1c50-4059-9db9-3fbccacc17be service nova] Creating event network-vif-plugged:92df63b2-2815-4499-b41a-e23801cf68f8 for instance c7690a69-d110-45d1-8a94-2c7c366bba36 on hv-cinder-81322 Dec 15 13:32:20.806049 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-f81c51d2-2091-4677-b280-9edda0b0cae5 req-f2bc9165-1c50-4059-9db9-3fbccacc17be service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046208 Dec 15 13:32:20.806920 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 130/270] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:32:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:32:20.812291 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-d2aa944b-b1f7-4d4a-b911-157908d93626 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:32:20.813228 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-d2aa944b-b1f7-4d4a-b911-157908d93626 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: d3c2da8c-7e29-48ac-9077-59bffb2c734b] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:20.821391 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d2aa944b-b1f7-4d4a-b911-157908d93626 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:20.822116 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d2aa944b-b1f7-4d4a-b911-157908d93626 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:20.823213 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d2aa944b-b1f7-4d4a-b911-157908d93626 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:20.823844 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d2aa944b-b1f7-4d4a-b911-157908d93626 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:20.883157 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-39def2e1-e7a1-42fb-b8a1-f0d45b15bb45 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:32:20.901309 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-39def2e1-e7a1-42fb-b8a1-f0d45b15bb45 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/c7690a69-d110-45d1-8a94-2c7c366bba36" status: 200 len: 1318 microversion: 2.1 time: 0.246329 Dec 15 13:32:20.901917 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 141/271] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:32:20 2021] GET /compute/v2.1/servers/c7690a69-d110-45d1-8a94-2c7c366bba36 => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:32:21.029617 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-d2aa944b-b1f7-4d4a-b911-157908d93626 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:32:21.038516 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-d2aa944b-b1f7-4d4a-b911-157908d93626 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b" status: 200 len: 1522 microversion: 2.1 time: 0.230168 Dec 15 13:32:21.039421 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 131/272] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:32:20 2021] GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:32:21.665544 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-5823177a-819c-4624-b42e-5a3d61c64025 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:32:21.666377 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-5823177a-819c-4624-b42e-5a3d61c64025 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:21.677644 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5823177a-819c-4624-b42e-5a3d61c64025 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:21.678113 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5823177a-819c-4624-b42e-5a3d61c64025 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:21.678947 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5823177a-819c-4624-b42e-5a3d61c64025 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:21.679395 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5823177a-819c-4624-b42e-5a3d61c64025 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:21.764631 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-2201bf05-18a5-46f2-84f7-bb3e866b21aa tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:32:21.765560 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-2201bf05-18a5-46f2-84f7-bb3e866b21aa tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:21.781659 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2201bf05-18a5-46f2-84f7-bb3e866b21aa tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:21.782123 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2201bf05-18a5-46f2-84f7-bb3e866b21aa tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:21.782955 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2201bf05-18a5-46f2-84f7-bb3e866b21aa tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:21.783621 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2201bf05-18a5-46f2-84f7-bb3e866b21aa tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:21.809648 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-5823177a-819c-4624-b42e-5a3d61c64025 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 27670 microversion: 2.1 time: 0.146323 Dec 15 13:32:21.810766 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 142/273] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:32:21 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 27670 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:32:21.902531 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-2201bf05-18a5-46f2-84f7-bb3e866b21aa tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 28052 microversion: 2.20 time: 0.140768 Dec 15 13:32:21.907865 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 132/274] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:32:21 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 28052 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:32:21.919947 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-eefab2a5-dc83-4a12-86b7-45af153e39e6 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:32:21.921040 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-eefab2a5-dc83-4a12-86b7-45af153e39e6 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: c7690a69-d110-45d1-8a94-2c7c366bba36] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:21.944244 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-eefab2a5-dc83-4a12-86b7-45af153e39e6 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:21.944902 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-eefab2a5-dc83-4a12-86b7-45af153e39e6 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:21.945906 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-eefab2a5-dc83-4a12-86b7-45af153e39e6 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:21.946516 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-eefab2a5-dc83-4a12-86b7-45af153e39e6 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:22.057686 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-3d3cbc6a-d2ad-42a2-b87b-e4f81a28475f tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:32:22.058995 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-3d3cbc6a-d2ad-42a2-b87b-e4f81a28475f tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: d3c2da8c-7e29-48ac-9077-59bffb2c734b] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:22.068259 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3d3cbc6a-d2ad-42a2-b87b-e4f81a28475f tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:22.069188 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3d3cbc6a-d2ad-42a2-b87b-e4f81a28475f tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:22.070234 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3d3cbc6a-d2ad-42a2-b87b-e4f81a28475f tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:22.071047 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3d3cbc6a-d2ad-42a2-b87b-e4f81a28475f tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:22.446520 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-3d3cbc6a-d2ad-42a2-b87b-e4f81a28475f tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:32:22.450291 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-eefab2a5-dc83-4a12-86b7-45af153e39e6 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:32:22.463273 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-eefab2a5-dc83-4a12-86b7-45af153e39e6 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/c7690a69-d110-45d1-8a94-2c7c366bba36" status: 200 len: 1318 microversion: 2.1 time: 0.548590 Dec 15 13:32:22.466507 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-3d3cbc6a-d2ad-42a2-b87b-e4f81a28475f tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b" status: 200 len: 1522 microversion: 2.1 time: 0.414287 Dec 15 13:32:22.480655 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 143/275] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:32:21 2021] GET /compute/v2.1/servers/c7690a69-d110-45d1-8a94-2c7c366bba36 => generated 1318 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:32:22.480852 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 133/276] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:32:22 2021] GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b => generated 1522 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:32:22.822533 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ddd8d0b0-59d2-4294-9cd9-06819c3bcdc6 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:32:22.828727 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ddd8d0b0-59d2-4294-9cd9-06819c3bcdc6 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:22.850398 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ddd8d0b0-59d2-4294-9cd9-06819c3bcdc6 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:22.850893 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ddd8d0b0-59d2-4294-9cd9-06819c3bcdc6 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:22.851701 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ddd8d0b0-59d2-4294-9cd9-06819c3bcdc6 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:22.852384 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ddd8d0b0-59d2-4294-9cd9-06819c3bcdc6 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:22.915309 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-05c31944-e52c-4179-a574-6862cf11ef33 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:32:22.916878 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-05c31944-e52c-4179-a574-6862cf11ef33 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:22.927299 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-05c31944-e52c-4179-a574-6862cf11ef33 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:22.931884 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-05c31944-e52c-4179-a574-6862cf11ef33 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:22.934768 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-05c31944-e52c-4179-a574-6862cf11ef33 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:22.935333 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-05c31944-e52c-4179-a574-6862cf11ef33 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:27.404753 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ddd8d0b0-59d2-4294-9cd9-06819c3bcdc6 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 27853 microversion: 2.1 time: 4.586360 Dec 15 13:32:27.407286 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 144/277] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:32:22 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 27853 bytes in 4590 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:32:27.410257 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-05c31944-e52c-4179-a574-6862cf11ef33 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 28052 microversion: 2.20 time: 4.498918 Dec 15 13:32:27.410944 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 134/278] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:32:22 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 28052 bytes in 4500 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:32:27.415895 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-cf6a3f38-9bca-4c8c-81eb-db8e70489800 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:32:27.416160 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-83c59690-5008-4c95-91a8-fd1c0eddb27d tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:32:27.416882 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-83c59690-5008-4c95-91a8-fd1c0eddb27d tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: c7690a69-d110-45d1-8a94-2c7c366bba36] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:27.419708 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-cf6a3f38-9bca-4c8c-81eb-db8e70489800 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: d3c2da8c-7e29-48ac-9077-59bffb2c734b] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:27.428105 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-cf6a3f38-9bca-4c8c-81eb-db8e70489800 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:27.428796 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-cf6a3f38-9bca-4c8c-81eb-db8e70489800 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:27.432547 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-cf6a3f38-9bca-4c8c-81eb-db8e70489800 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:27.433246 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-cf6a3f38-9bca-4c8c-81eb-db8e70489800 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:27.439761 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-83c59690-5008-4c95-91a8-fd1c0eddb27d tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:27.440206 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-83c59690-5008-4c95-91a8-fd1c0eddb27d tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:27.441012 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-83c59690-5008-4c95-91a8-fd1c0eddb27d tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:27.441452 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-83c59690-5008-4c95-91a8-fd1c0eddb27d tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:27.680264 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-83c59690-5008-4c95-91a8-fd1c0eddb27d tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:32:27.697586 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-83c59690-5008-4c95-91a8-fd1c0eddb27d tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/c7690a69-d110-45d1-8a94-2c7c366bba36" status: 200 len: 1318 microversion: 2.1 time: 0.285255 Dec 15 13:32:27.698184 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 135/279] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:32:27 2021] GET /compute/v2.1/servers/c7690a69-d110-45d1-8a94-2c7c366bba36 => generated 1318 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:32:27.746371 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-cf6a3f38-9bca-4c8c-81eb-db8e70489800 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:32:27.757125 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-cf6a3f38-9bca-4c8c-81eb-db8e70489800 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b" status: 200 len: 1522 microversion: 2.1 time: 0.347635 Dec 15 13:32:27.758130 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 145/280] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:32:27 2021] GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b => generated 1522 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:32:28.419341 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-4adbe97e-2e33-49cd-89b0-82e623dc15ef tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:32:28.420951 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-4adbe97e-2e33-49cd-89b0-82e623dc15ef tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:28.422596 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-a58e3fa6-5575-444f-9ffa-ac5602d90733 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:32:28.424195 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-a58e3fa6-5575-444f-9ffa-ac5602d90733 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:28.430745 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4adbe97e-2e33-49cd-89b0-82e623dc15ef tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:28.431467 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4adbe97e-2e33-49cd-89b0-82e623dc15ef tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:28.432473 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4adbe97e-2e33-49cd-89b0-82e623dc15ef tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:28.432913 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4adbe97e-2e33-49cd-89b0-82e623dc15ef tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:28.439858 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a58e3fa6-5575-444f-9ffa-ac5602d90733 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:28.444856 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a58e3fa6-5575-444f-9ffa-ac5602d90733 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:28.445796 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a58e3fa6-5575-444f-9ffa-ac5602d90733 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:28.446356 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a58e3fa6-5575-444f-9ffa-ac5602d90733 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:28.592641 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-4adbe97e-2e33-49cd-89b0-82e623dc15ef tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 27919 microversion: 2.1 time: 0.178667 Dec 15 13:32:28.598331 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 136/281] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:32:28 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 27919 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:32:28.716546 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-db1aee9d-2ea4-41f9-bb0b-3ef4fe6db629 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:32:28.718000 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-db1aee9d-2ea4-41f9-bb0b-3ef4fe6db629 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: c7690a69-d110-45d1-8a94-2c7c366bba36] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:28.729694 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-db1aee9d-2ea4-41f9-bb0b-3ef4fe6db629 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:28.730159 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-db1aee9d-2ea4-41f9-bb0b-3ef4fe6db629 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:28.731151 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-db1aee9d-2ea4-41f9-bb0b-3ef4fe6db629 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:28.731732 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-db1aee9d-2ea4-41f9-bb0b-3ef4fe6db629 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:28.931309 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-db1aee9d-2ea4-41f9-bb0b-3ef4fe6db629 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:32:28.941825 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-db1aee9d-2ea4-41f9-bb0b-3ef4fe6db629 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/c7690a69-d110-45d1-8a94-2c7c366bba36" status: 200 len: 1508 microversion: 2.1 time: 0.230280 Dec 15 13:32:28.942729 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 137/282] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:32:28 2021] GET /compute/v2.1/servers/c7690a69-d110-45d1-8a94-2c7c366bba36 => generated 1508 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:32:28.947212 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-43a5aab6-2918-449a-ba5e-b8af41d56752 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:32:28.947814 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-43a5aab6-2918-449a-ba5e-b8af41d56752 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: d3c2da8c-7e29-48ac-9077-59bffb2c734b] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:28.953793 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-43a5aab6-2918-449a-ba5e-b8af41d56752 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:28.954831 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-43a5aab6-2918-449a-ba5e-b8af41d56752 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:28.955686 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-43a5aab6-2918-449a-ba5e-b8af41d56752 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:28.956117 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-43a5aab6-2918-449a-ba5e-b8af41d56752 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:29.099581 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-43a5aab6-2918-449a-ba5e-b8af41d56752 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:32:29.107411 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-43a5aab6-2918-449a-ba5e-b8af41d56752 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b" status: 200 len: 1522 microversion: 2.1 time: 0.163569 Dec 15 13:32:29.108212 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 138/283] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:32:28 2021] GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:32:29.112922 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-2740237f-1283-47c5-8a42-5ca1853e74ee tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b433b021-1ef8-4beb-8a18-7aad3e1c7c09"}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:32:29.113952 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-2740237f-1283-47c5-8a42-5ca1853e74ee tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: c7690a69-d110-45d1-8a94-2c7c366bba36] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:29.119511 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2740237f-1283-47c5-8a42-5ca1853e74ee tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:29.120134 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2740237f-1283-47c5-8a42-5ca1853e74ee tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:29.121062 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2740237f-1283-47c5-8a42-5ca1853e74ee tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:29.121638 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2740237f-1283-47c5-8a42-5ca1853e74ee tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:29.221227 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.wsgi [None req-2740237f-1283-47c5-8a42-5ca1853e74ee tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] HTTP exception thrown: Invalid volume: volume b433b021-1ef8-4beb-8a18-7aad3e1c7c09 is already attached to instances: 10dd91a3-b40e-4ac3-ac2c-63624e87cf93 Dec 15 13:32:29.221831 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-2740237f-1283-47c5-8a42-5ca1853e74ee tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Returning 400 to user: Invalid volume: volume b433b021-1ef8-4beb-8a18-7aad3e1c7c09 is already attached to instances: 10dd91a3-b40e-4ac3-ac2c-63624e87cf93 {{(pid=116941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:32:29.222660 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-2740237f-1283-47c5-8a42-5ca1853e74ee tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "POST /compute/v2.1/servers/c7690a69-d110-45d1-8a94-2c7c366bba36/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.113411 Dec 15 13:32:29.223257 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 139/284] 10.222.0.60 () {60 vars in 1322 bytes} [Wed Dec 15 13:32:29 2021] POST /compute/v2.1/servers/c7690a69-d110-45d1-8a94-2c7c366bba36/os-volume_attachments => generated 174 bytes in 114 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 15 13:32:29.286460 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-b1ca91aa-6c49-4ca1-898b-b287544bc1a8 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:32:29.286971 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-b1ca91aa-6c49-4ca1-898b-b287544bc1a8 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 10dd91a3-b40e-4ac3-ac2c-63624e87cf93] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:29.294411 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b1ca91aa-6c49-4ca1-898b-b287544bc1a8 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:29.295188 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b1ca91aa-6c49-4ca1-898b-b287544bc1a8 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:29.295976 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b1ca91aa-6c49-4ca1-898b-b287544bc1a8 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:29.296404 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b1ca91aa-6c49-4ca1-898b-b287544bc1a8 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:29.440881 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.objects.instance [None req-b1ca91aa-6c49-4ca1-898b-b287544bc1a8 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lazy-loading 'services' on Instance uuid 10dd91a3-b40e-4ac3-ac2c-63624e87cf93 {{(pid=116941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:32:29.732200 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-b1ca91aa-6c49-4ca1-898b-b287544bc1a8 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "DELETE /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93/os-volume_attachments/b433b021-1ef8-4beb-8a18-7aad3e1c7c09" status: 202 len: 0 microversion: 2.1 time: 0.450048 Dec 15 13:32:29.733076 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 140/285] 10.222.0.60 () {58 vars in 1415 bytes} [Wed Dec 15 13:32:29 2021] DELETE /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93/os-volume_attachments/b433b021-1ef8-4beb-8a18-7aad3e1c7c09 => generated 0 bytes in 452 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:32:29.739140 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-2a9fef52-4dd9-4051-a3dd-165e21e98adf tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:32:29.740420 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-2a9fef52-4dd9-4051-a3dd-165e21e98adf tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:29.747326 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2a9fef52-4dd9-4051-a3dd-165e21e98adf tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:29.747959 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2a9fef52-4dd9-4051-a3dd-165e21e98adf tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:29.748915 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2a9fef52-4dd9-4051-a3dd-165e21e98adf tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:29.749532 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2a9fef52-4dd9-4051-a3dd-165e21e98adf tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:33.205850 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-a58e3fa6-5575-444f-9ffa-ac5602d90733 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 28167 microversion: 2.20 time: 4.787693 Dec 15 13:32:33.207618 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 146/286] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:32:28 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 28167 bytes in 4790 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:32:33.212526 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-607fa1d0-3a40-49fc-977c-2853e66771f6 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:32:33.213508 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-607fa1d0-3a40-49fc-977c-2853e66771f6 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 10dd91a3-b40e-4ac3-ac2c-63624e87cf93] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:33.223968 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-607fa1d0-3a40-49fc-977c-2853e66771f6 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:33.224677 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-607fa1d0-3a40-49fc-977c-2853e66771f6 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:33.225765 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-607fa1d0-3a40-49fc-977c-2853e66771f6 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:33.226344 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-607fa1d0-3a40-49fc-977c-2853e66771f6 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:33.268508 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-607fa1d0-3a40-49fc-977c-2853e66771f6 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059642 Dec 15 13:32:33.269395 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 147/287] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Dec 15 13:32:33 2021] GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:32:33.273897 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-c2f03b67-45c9-4448-823d-53991c049c3b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:32:33.274491 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-c2f03b67-45c9-4448-823d-53991c049c3b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: d3c2da8c-7e29-48ac-9077-59bffb2c734b] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:33.281689 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c2f03b67-45c9-4448-823d-53991c049c3b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:33.282661 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c2f03b67-45c9-4448-823d-53991c049c3b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:33.283489 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c2f03b67-45c9-4448-823d-53991c049c3b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:33.283919 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c2f03b67-45c9-4448-823d-53991c049c3b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:33.313990 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-2a9fef52-4dd9-4051-a3dd-165e21e98adf tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 27919 microversion: 2.1 time: 3.579260 Dec 15 13:32:33.314562 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 141/288] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:32:29 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 27919 bytes in 3581 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:32:33.439687 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-c2f03b67-45c9-4448-823d-53991c049c3b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:32:33.447532 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-c2f03b67-45c9-4448-823d-53991c049c3b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b" status: 200 len: 1522 microversion: 2.1 time: 0.176874 Dec 15 13:32:33.448159 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 148/289] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:32:33 2021] GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:32:34.217894 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-585792d0-e3fb-4802-80bd-f51f43eeb376 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:32:34.218915 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-585792d0-e3fb-4802-80bd-f51f43eeb376 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:34.226077 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-585792d0-e3fb-4802-80bd-f51f43eeb376 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:34.226528 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-585792d0-e3fb-4802-80bd-f51f43eeb376 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:34.227778 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-585792d0-e3fb-4802-80bd-f51f43eeb376 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:34.228222 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-585792d0-e3fb-4802-80bd-f51f43eeb376 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:34.280139 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-a86accec-0405-4db9-8606-60ef1eca0bbb tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:32:34.281836 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-a86accec-0405-4db9-8606-60ef1eca0bbb tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 10dd91a3-b40e-4ac3-ac2c-63624e87cf93] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:34.288389 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a86accec-0405-4db9-8606-60ef1eca0bbb tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:34.288853 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a86accec-0405-4db9-8606-60ef1eca0bbb tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:34.289656 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a86accec-0405-4db9-8606-60ef1eca0bbb tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:34.290097 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a86accec-0405-4db9-8606-60ef1eca0bbb tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:34.320879 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-a86accec-0405-4db9-8606-60ef1eca0bbb tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044611 Dec 15 13:32:34.321519 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 149/290] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Dec 15 13:32:34 2021] GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:32:34.325703 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-7fa8372e-e459-4d98-a3d7-9eaea224183f tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Action: 'create', calling method: .version_select at 0x7ff50ff8d1f0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-268205629"}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:32:34.332719 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-585792d0-e3fb-4802-80bd-f51f43eeb376 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 28167 microversion: 2.20 time: 0.118605 Dec 15 13:32:34.337760 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 142/291] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:32:34 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 28167 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:32:34.338390 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-487d761b-e411-458e-8b2c-b2a7d5a6738d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:32:34.339484 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-487d761b-e411-458e-8b2c-b2a7d5a6738d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:34.346664 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-487d761b-e411-458e-8b2c-b2a7d5a6738d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:34.347253 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-487d761b-e411-458e-8b2c-b2a7d5a6738d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:34.347359 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-7fa8372e-e459-4d98-a3d7-9eaea224183f tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Getting quotas for project c38faa56e5864d3aba51e1e8351e3a93. Resources: {'key_pairs'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:32:34.348075 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-487d761b-e411-458e-8b2c-b2a7d5a6738d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:34.348516 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-487d761b-e411-458e-8b2c-b2a7d5a6738d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:34.351245 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-7fa8372e-e459-4d98-a3d7-9eaea224183f tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Getting quotas for user 5ed1331bcb0e4fe4a53379d1d72f650a and project c38faa56e5864d3aba51e1e8351e3a93. Resources: {'key_pairs'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:32:34.436237 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-487d761b-e411-458e-8b2c-b2a7d5a6738d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 27919 microversion: 2.1 time: 0.101480 Dec 15 13:32:34.436962 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 143/292] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:32:34 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 27919 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:32:34.476352 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-04c8166b-f76a-40d9-97a2-9fa837c7fec7 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:32:34.477175 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-04c8166b-f76a-40d9-97a2-9fa837c7fec7 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: d3c2da8c-7e29-48ac-9077-59bffb2c734b] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:34.484005 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-04c8166b-f76a-40d9-97a2-9fa837c7fec7 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:34.484456 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-04c8166b-f76a-40d9-97a2-9fa837c7fec7 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:34.485861 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-04c8166b-f76a-40d9-97a2-9fa837c7fec7 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:34.486343 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-04c8166b-f76a-40d9-97a2-9fa837c7fec7 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:34.536474 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-7fa8372e-e459-4d98-a3d7-9eaea224183f tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Getting quotas for project c38faa56e5864d3aba51e1e8351e3a93. Resources: {'key_pairs'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:32:34.540180 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-7fa8372e-e459-4d98-a3d7-9eaea224183f tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Getting quotas for user 5ed1331bcb0e4fe4a53379d1d72f650a and project c38faa56e5864d3aba51e1e8351e3a93. Resources: {'key_pairs'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:32:34.553637 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-7fa8372e-e459-4d98-a3d7-9eaea224183f tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.231216 Dec 15 13:32:34.554237 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 150/293] 10.222.0.60 () {60 vars in 1157 bytes} [Wed Dec 15 13:32:34 2021] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:32:34.603916 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ae773709-bd4d-4621-b157-530482fc6bc3 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-387231012", "imageRef": "36d6dcd1-892d-4b56-b269-947ac98a7ef6", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-268205629", "networks": [{"uuid": "3f012c5b-1c5f-453a-9cf1-19ced471c3f5"}]}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:32:34.640432 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-04c8166b-f76a-40d9-97a2-9fa837c7fec7 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:32:34.648689 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-04c8166b-f76a-40d9-97a2-9fa837c7fec7 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b" status: 200 len: 1522 microversion: 2.1 time: 0.176038 Dec 15 13:32:34.649261 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 144/294] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:32:34 2021] GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:32:34.660391 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.network.neutron [None req-ae773709-bd4d-4621-b157-530482fc6bc3 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] validate_networks() for [('3f012c5b-1c5f-453a-9cf1-19ced471c3f5', None, None, None, None, None)] {{(pid=116942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:32:35.024846 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-ae773709-bd4d-4621-b157-530482fc6bc3 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Flavor limits 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:32:35.025318 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-ae773709-bd4d-4621-b157-530482fc6bc3 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Image limits 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:32:35.025797 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-ae773709-bd4d-4621-b157-530482fc6bc3 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Flavor pref 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:32:35.026340 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-ae773709-bd4d-4621-b157-530482fc6bc3 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Image pref 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:32:35.026763 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-ae773709-bd4d-4621-b157-530482fc6bc3 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:32:35.037124 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ae773709-bd4d-4621-b157-530482fc6bc3 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:35.037572 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ae773709-bd4d-4621-b157-530482fc6bc3 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:35.038386 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ae773709-bd4d-4621-b157-530482fc6bc3 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:35.038824 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ae773709-bd4d-4621-b157-530482fc6bc3 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:35.057584 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-ae773709-bd4d-4621-b157-530482fc6bc3 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Getting quotas for project c38faa56e5864d3aba51e1e8351e3a93. Resources: {'cores', 'instances', 'ram'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:32:35.061596 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-ae773709-bd4d-4621-b157-530482fc6bc3 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Getting quotas for user 5ed1331bcb0e4fe4a53379d1d72f650a and project c38faa56e5864d3aba51e1e8351e3a93. Resources: {'cores', 'instances', 'ram'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:32:35.073044 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ae773709-bd4d-4621-b157-530482fc6bc3 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Going to run 1 instances... {{(pid=116942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:32:35.075769 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ae773709-bd4d-4621-b157-530482fc6bc3 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='36d6dcd1-892d-4b56-b269-947ac98a7ef6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:32:35.134480 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ae773709-bd4d-4621-b157-530482fc6bc3 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.534113 Dec 15 13:32:35.135322 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 151/295] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Dec 15 13:32:34 2021] POST /compute/v2.1/servers => generated 380 bytes in 536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 15 13:32:35.145829 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-c67b5cdb-9dd1-4fa7-b332-f3f87b1da0d9 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:32:35.146521 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-c67b5cdb-9dd1-4fa7-b332-f3f87b1da0d9 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:35.228626 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-c67b5cdb-9dd1-4fa7-b332-f3f87b1da0d9 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed1331bcb0e4fe4a53379d1d72f650a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38faa56e5864d3aba51e1e8351e3a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:32:35.235666 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-c67b5cdb-9dd1-4fa7-b332-f3f87b1da0d9 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb" status: 200 len: 1257 microversion: 2.1 time: 0.093520 Dec 15 13:32:35.236733 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 145/296] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:32:35 2021] GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb => generated 1257 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:32:35.334337 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-15dbcfd4-5e1e-444a-8346-734bc768fd73 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:32:35.336677 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-15dbcfd4-5e1e-444a-8346-734bc768fd73 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 10dd91a3-b40e-4ac3-ac2c-63624e87cf93] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:35.344762 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-15dbcfd4-5e1e-444a-8346-734bc768fd73 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:35.344961 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-9548c0dd-ecc2-466d-a3d7-3219451f181f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:32:35.346006 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-15dbcfd4-5e1e-444a-8346-734bc768fd73 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:35.346192 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-9548c0dd-ecc2-466d-a3d7-3219451f181f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:35.347151 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-15dbcfd4-5e1e-444a-8346-734bc768fd73 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:35.347738 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-15dbcfd4-5e1e-444a-8346-734bc768fd73 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:35.357183 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9548c0dd-ecc2-466d-a3d7-3219451f181f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:35.357925 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9548c0dd-ecc2-466d-a3d7-3219451f181f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:35.363709 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9548c0dd-ecc2-466d-a3d7-3219451f181f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:35.364509 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9548c0dd-ecc2-466d-a3d7-3219451f181f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:35.384219 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-15dbcfd4-5e1e-444a-8346-734bc768fd73 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056074 Dec 15 13:32:35.385113 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 152/297] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Dec 15 13:32:35 2021] GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:32:35.458311 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-bfe1863d-3e54-4d50-9415-936b50d9b51a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:32:35.459390 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-9548c0dd-ecc2-466d-a3d7-3219451f181f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 28167 microversion: 2.20 time: 0.118044 Dec 15 13:32:35.459694 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-bfe1863d-3e54-4d50-9415-936b50d9b51a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:35.463893 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 146/298] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:32:35 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 28167 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:32:35.468154 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-bfe1863d-3e54-4d50-9415-936b50d9b51a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:35.468719 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-bfe1863d-3e54-4d50-9415-936b50d9b51a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:35.469825 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-bfe1863d-3e54-4d50-9415-936b50d9b51a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:35.470356 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-bfe1863d-3e54-4d50-9415-936b50d9b51a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:35.581784 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-bfe1863d-3e54-4d50-9415-936b50d9b51a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 28084 microversion: 2.1 time: 0.128837 Dec 15 13:32:35.582893 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 153/299] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:32:35 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 28084 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:32:35.635101 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-ff52e8c9-4869-4d95-8bfa-dc7c665b7f9d tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-156794788", "imageRef": "cfccedbb-7169-47ec-9bae-d4829cba54e1", "flavorRef": "452", "networks": [{"uuid": "12997ed3-8144-436a-8d20-22135e6511e5"}]}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:32:35.666726 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-6a545aaa-d3bc-493f-9a0f-2191155a582b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:32:35.667456 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-6a545aaa-d3bc-493f-9a0f-2191155a582b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: d3c2da8c-7e29-48ac-9077-59bffb2c734b] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:35.675841 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6a545aaa-d3bc-493f-9a0f-2191155a582b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:35.676683 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6a545aaa-d3bc-493f-9a0f-2191155a582b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:35.677532 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6a545aaa-d3bc-493f-9a0f-2191155a582b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:35.678180 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6a545aaa-d3bc-493f-9a0f-2191155a582b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:35.707195 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.network.neutron [None req-ff52e8c9-4869-4d95-8bfa-dc7c665b7f9d tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] validate_networks() for [('12997ed3-8144-436a-8d20-22135e6511e5', None, None, None, None, None)] {{(pid=116941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:32:35.917308 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-6a545aaa-d3bc-493f-9a0f-2191155a582b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:32:35.928842 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-6a545aaa-d3bc-493f-9a0f-2191155a582b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b" status: 200 len: 1522 microversion: 2.1 time: 0.267044 Dec 15 13:32:35.929437 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 154/300] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:32:35 2021] GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:32:36.143502 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-ff52e8c9-4869-4d95-8bfa-dc7c665b7f9d tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Flavor limits 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:32:36.143941 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-ff52e8c9-4869-4d95-8bfa-dc7c665b7f9d tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Image limits 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:32:36.144411 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-ff52e8c9-4869-4d95-8bfa-dc7c665b7f9d tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Flavor pref 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:32:36.144816 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-ff52e8c9-4869-4d95-8bfa-dc7c665b7f9d tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Image pref 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:32:36.145222 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-ff52e8c9-4869-4d95-8bfa-dc7c665b7f9d tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:32:36.153877 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ff52e8c9-4869-4d95-8bfa-dc7c665b7f9d tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:36.154319 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ff52e8c9-4869-4d95-8bfa-dc7c665b7f9d tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:36.155166 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ff52e8c9-4869-4d95-8bfa-dc7c665b7f9d tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:36.155585 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ff52e8c9-4869-4d95-8bfa-dc7c665b7f9d tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:36.173131 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-ff52e8c9-4869-4d95-8bfa-dc7c665b7f9d tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Getting quotas for project 18c80dfcc63a49f7b54f89f08cd8842f. Resources: {'cores', 'instances', 'ram'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:32:36.176879 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-ff52e8c9-4869-4d95-8bfa-dc7c665b7f9d tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Getting quotas for user df94523ab7c545f2a17a2cafe936d2ed and project 18c80dfcc63a49f7b54f89f08cd8842f. Resources: {'cores', 'instances', 'ram'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:32:36.187133 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-ff52e8c9-4869-4d95-8bfa-dc7c665b7f9d tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Going to run 1 instances... {{(pid=116941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:32:36.189499 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-ff52e8c9-4869-4d95-8bfa-dc7c665b7f9d tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 20c19dcc-7224-44dc-8921-a03017d002d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cfccedbb-7169-47ec-9bae-d4829cba54e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:32:36.233398 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-ff52e8c9-4869-4d95-8bfa-dc7c665b7f9d tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.611882 Dec 15 13:32:36.234243 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 147/301] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Dec 15 13:32:35 2021] POST /compute/v2.1/servers => generated 380 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 13:32:36.244567 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-3a66c21c-9318-4ecc-a423-125f81d731aa tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:32:36.245176 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-3a66c21c-9318-4ecc-a423-125f81d731aa tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 20c19dcc-7224-44dc-8921-a03017d002d7] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:36.253398 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-a9e1499c-130f-416b-b1bb-43926c3389fb tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:32:36.254027 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-a9e1499c-130f-416b-b1bb-43926c3389fb tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:36.260471 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a9e1499c-130f-416b-b1bb-43926c3389fb tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:36.260939 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a9e1499c-130f-416b-b1bb-43926c3389fb tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:36.261772 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a9e1499c-130f-416b-b1bb-43926c3389fb tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:36.262212 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a9e1499c-130f-416b-b1bb-43926c3389fb tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:36.313398 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-3a66c21c-9318-4ecc-a423-125f81d731aa tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:32:36.321294 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-3a66c21c-9318-4ecc-a423-125f81d731aa tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/20c19dcc-7224-44dc-8921-a03017d002d7" status: 200 len: 1217 microversion: 2.1 time: 0.080434 Dec 15 13:32:36.322797 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 155/302] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:32:36 2021] GET /compute/v2.1/servers/20c19dcc-7224-44dc-8921-a03017d002d7 => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:32:36.340903 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-a9e1499c-130f-416b-b1bb-43926c3389fb tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed1331bcb0e4fe4a53379d1d72f650a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38faa56e5864d3aba51e1e8351e3a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:32:36.349860 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-a9e1499c-130f-416b-b1bb-43926c3389fb tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb" status: 200 len: 1309 microversion: 2.1 time: 0.100528 Dec 15 13:32:36.350487 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 148/303] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:32:36 2021] GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb => generated 1309 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:32:36.471854 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-e8dd79be-d782-40f2-965e-a7dbb3654cf7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:32:36.472757 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-e8dd79be-d782-40f2-965e-a7dbb3654cf7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:36.479046 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e8dd79be-d782-40f2-965e-a7dbb3654cf7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:36.479621 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e8dd79be-d782-40f2-965e-a7dbb3654cf7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:36.480492 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e8dd79be-d782-40f2-965e-a7dbb3654cf7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:36.480970 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e8dd79be-d782-40f2-965e-a7dbb3654cf7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:36.575084 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-e8dd79be-d782-40f2-965e-a7dbb3654cf7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 28167 microversion: 2.20 time: 0.107032 Dec 15 13:32:36.579082 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 156/304] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:32:36 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 28167 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:32:36.593208 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-744d4588-81e9-4afb-b920-6fc45543d74f tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:32:36.595121 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-744d4588-81e9-4afb-b920-6fc45543d74f tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:36.605730 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-744d4588-81e9-4afb-b920-6fc45543d74f tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:36.606427 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-744d4588-81e9-4afb-b920-6fc45543d74f tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:36.608041 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-744d4588-81e9-4afb-b920-6fc45543d74f tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:36.608994 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-744d4588-81e9-4afb-b920-6fc45543d74f tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:36.707440 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-744d4588-81e9-4afb-b920-6fc45543d74f tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 28201 microversion: 2.1 time: 0.117511 Dec 15 13:32:36.708359 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 149/305] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:32:36 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 28201 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:32:36.947672 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-af7f089e-f693-475f-b7eb-360b8a0a5aff tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:32:36.948668 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-af7f089e-f693-475f-b7eb-360b8a0a5aff tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: d3c2da8c-7e29-48ac-9077-59bffb2c734b] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:36.965674 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-af7f089e-f693-475f-b7eb-360b8a0a5aff tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:36.968383 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-af7f089e-f693-475f-b7eb-360b8a0a5aff tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:36.972145 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-af7f089e-f693-475f-b7eb-360b8a0a5aff tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:36.972754 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-af7f089e-f693-475f-b7eb-360b8a0a5aff tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:37.259622 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-af7f089e-f693-475f-b7eb-360b8a0a5aff tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:32:37.275817 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-af7f089e-f693-475f-b7eb-360b8a0a5aff tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b" status: 200 len: 1522 microversion: 2.1 time: 0.333222 Dec 15 13:32:37.277092 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 157/306] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:32:36 2021] GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b => generated 1522 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:32:37.340159 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-8b26c657-10e0-453f-9f01-3d6cb99e2b6f tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:32:37.341314 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-8b26c657-10e0-453f-9f01-3d6cb99e2b6f tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 20c19dcc-7224-44dc-8921-a03017d002d7] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:37.351593 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8b26c657-10e0-453f-9f01-3d6cb99e2b6f tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:37.354187 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8b26c657-10e0-453f-9f01-3d6cb99e2b6f tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:37.356676 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8b26c657-10e0-453f-9f01-3d6cb99e2b6f tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:37.360732 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8b26c657-10e0-453f-9f01-3d6cb99e2b6f tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:37.367002 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-06fed6fc-6d5e-4200-8902-b97b06017c66 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:32:37.367960 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-06fed6fc-6d5e-4200-8902-b97b06017c66 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:37.377732 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-06fed6fc-6d5e-4200-8902-b97b06017c66 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:37.379377 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-06fed6fc-6d5e-4200-8902-b97b06017c66 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:37.381388 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-06fed6fc-6d5e-4200-8902-b97b06017c66 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:37.382569 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-06fed6fc-6d5e-4200-8902-b97b06017c66 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:37.486207 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-8b26c657-10e0-453f-9f01-3d6cb99e2b6f tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:32:37.493429 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-8b26c657-10e0-453f-9f01-3d6cb99e2b6f tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/20c19dcc-7224-44dc-8921-a03017d002d7" status: 200 len: 1269 microversion: 2.1 time: 0.157436 Dec 15 13:32:37.494003 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 150/307] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:32:37 2021] GET /compute/v2.1/servers/20c19dcc-7224-44dc-8921-a03017d002d7 => generated 1269 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:32:37.550916 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-06fed6fc-6d5e-4200-8902-b97b06017c66 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed1331bcb0e4fe4a53379d1d72f650a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38faa56e5864d3aba51e1e8351e3a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:32:37.558292 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-06fed6fc-6d5e-4200-8902-b97b06017c66 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb" status: 200 len: 1357 microversion: 2.1 time: 0.195434 Dec 15 13:32:37.558896 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 158/308] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:32:37 2021] GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb => generated 1357 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:32:37.588973 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-d6849f68-62ff-4ad1-b227-9da85670286f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:32:37.589932 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-d6849f68-62ff-4ad1-b227-9da85670286f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:37.596717 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d6849f68-62ff-4ad1-b227-9da85670286f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:37.597161 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d6849f68-62ff-4ad1-b227-9da85670286f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:37.597935 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d6849f68-62ff-4ad1-b227-9da85670286f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:37.598359 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d6849f68-62ff-4ad1-b227-9da85670286f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:37.719835 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-3ba7b7d3-b5bf-47d0-9d4f-bd38ad0a9107 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:32:37.720910 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-3ba7b7d3-b5bf-47d0-9d4f-bd38ad0a9107 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:32:37.726944 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3ba7b7d3-b5bf-47d0-9d4f-bd38ad0a9107 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:37.727404 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3ba7b7d3-b5bf-47d0-9d4f-bd38ad0a9107 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:32:37.728189 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3ba7b7d3-b5bf-47d0-9d4f-bd38ad0a9107 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:32:37.728633 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3ba7b7d3-b5bf-47d0-9d4f-bd38ad0a9107 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:00.994953 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-3ba7b7d3-b5bf-47d0-9d4f-bd38ad0a9107 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 28201 microversion: 2.1 time: 23.279099 Dec 15 13:33:00.995655 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 159/309] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:32:37 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 28201 bytes in 23281 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:33:01.000882 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-6376b4ef-41cc-4cec-911e-2bd627dfdbc7 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:01.001581 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-6376b4ef-41cc-4cec-911e-2bd627dfdbc7 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: d3c2da8c-7e29-48ac-9077-59bffb2c734b] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:01.008801 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6376b4ef-41cc-4cec-911e-2bd627dfdbc7 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:01.009241 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6376b4ef-41cc-4cec-911e-2bd627dfdbc7 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:01.010045 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6376b4ef-41cc-4cec-911e-2bd627dfdbc7 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:01.010479 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6376b4ef-41cc-4cec-911e-2bd627dfdbc7 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:01.013479 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-d6849f68-62ff-4ad1-b227-9da85670286f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 28167 microversion: 2.20 time: 23.428049 Dec 15 13:33:01.014125 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 151/310] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:32:37 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 28167 bytes in 23430 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:33:01.020081 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-e8b6bcec-737d-4a73-a496-f3943a4ca613 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:01.021027 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-e8b6bcec-737d-4a73-a496-f3943a4ca613 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 20c19dcc-7224-44dc-8921-a03017d002d7] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:01.027860 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e8b6bcec-737d-4a73-a496-f3943a4ca613 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:01.028311 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e8b6bcec-737d-4a73-a496-f3943a4ca613 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:01.029106 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e8b6bcec-737d-4a73-a496-f3943a4ca613 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:01.029539 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e8b6bcec-737d-4a73-a496-f3943a4ca613 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:01.106230 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-e8b6bcec-737d-4a73-a496-f3943a4ca613 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:01.115330 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-e8b6bcec-737d-4a73-a496-f3943a4ca613 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/20c19dcc-7224-44dc-8921-a03017d002d7" status: 200 len: 1269 microversion: 2.1 time: 0.099586 Dec 15 13:33:01.116227 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 152/311] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:01 2021] GET /compute/v2.1/servers/20c19dcc-7224-44dc-8921-a03017d002d7 => generated 1269 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:33:01.121469 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-1bf1321a-98ce-4adc-a3f7-7bce2322faa3 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:01.122290 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-1bf1321a-98ce-4adc-a3f7-7bce2322faa3 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:01.129628 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1bf1321a-98ce-4adc-a3f7-7bce2322faa3 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:01.130297 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1bf1321a-98ce-4adc-a3f7-7bce2322faa3 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:01.131439 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1bf1321a-98ce-4adc-a3f7-7bce2322faa3 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:01.132059 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1bf1321a-98ce-4adc-a3f7-7bce2322faa3 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:01.195112 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-6376b4ef-41cc-4cec-911e-2bd627dfdbc7 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:01.202756 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-6376b4ef-41cc-4cec-911e-2bd627dfdbc7 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b" status: 200 len: 1522 microversion: 2.1 time: 0.206042 Dec 15 13:33:01.203409 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 160/312] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:00 2021] GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:33:01.208039 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-9b282ec0-92f0-41e4-9d95-ca2394e8910c req-0d613e4b-3639-4b16-a83a-d11445f9c67b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f21e20b-c80e-408b-849e-cf9e27127cbb", "tag": "f90cb0df-c11c-44a8-b09b-274188bbac57"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:01.209903 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:33:01.209903 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: warnings.warn(msg) Dec 15 13:33:01.216832 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-9b282ec0-92f0-41e4-9d95-ca2394e8910c req-0d613e4b-3639-4b16-a83a-d11445f9c67b service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:01.217290 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-9b282ec0-92f0-41e4-9d95-ca2394e8910c req-0d613e4b-3639-4b16-a83a-d11445f9c67b service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:01.228294 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-9b282ec0-92f0-41e4-9d95-ca2394e8910c req-0d613e4b-3639-4b16-a83a-d11445f9c67b service nova] Creating event network-changed:f90cb0df-c11c-44a8-b09b-274188bbac57 for instance 9f21e20b-c80e-408b-849e-cf9e27127cbb on hv-cinder-81322 Dec 15 13:33:01.233919 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-9b282ec0-92f0-41e4-9d95-ca2394e8910c req-0d613e4b-3639-4b16-a83a-d11445f9c67b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029063 Dec 15 13:33:01.235390 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 161/313] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:33:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:33:01.292598 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-1bf1321a-98ce-4adc-a3f7-7bce2322faa3 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed1331bcb0e4fe4a53379d1d72f650a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38faa56e5864d3aba51e1e8351e3a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:01.300780 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-1bf1321a-98ce-4adc-a3f7-7bce2322faa3 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb" status: 200 len: 1357 microversion: 2.1 time: 0.183400 Dec 15 13:33:01.301341 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 153/314] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:01 2021] GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb => generated 1357 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:33:02.007248 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-c63e32d3-84eb-48d7-a0bc-341bda3fc414 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:02.009135 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-c63e32d3-84eb-48d7-a0bc-341bda3fc414 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:02.016627 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c63e32d3-84eb-48d7-a0bc-341bda3fc414 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:02.017136 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c63e32d3-84eb-48d7-a0bc-341bda3fc414 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:02.017928 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c63e32d3-84eb-48d7-a0bc-341bda3fc414 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:02.018531 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c63e32d3-84eb-48d7-a0bc-341bda3fc414 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:02.025691 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-c3eba706-6ef2-475c-a5b1-5e583a11c84a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:02.027168 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-c3eba706-6ef2-475c-a5b1-5e583a11c84a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:02.034565 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c3eba706-6ef2-475c-a5b1-5e583a11c84a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:02.035265 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c3eba706-6ef2-475c-a5b1-5e583a11c84a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:02.036214 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c3eba706-6ef2-475c-a5b1-5e583a11c84a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:02.036789 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c3eba706-6ef2-475c-a5b1-5e583a11c84a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:06.103353 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-c63e32d3-84eb-48d7-a0bc-341bda3fc414 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 28201 microversion: 2.1 time: 4.099836 Dec 15 13:33:06.104390 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 162/315] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:33:02 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 28201 bytes in 4102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:33:06.109812 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-4cafb1d6-93ba-4c71-9211-02602e464a7f tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:06.110524 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-4cafb1d6-93ba-4c71-9211-02602e464a7f tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 20c19dcc-7224-44dc-8921-a03017d002d7] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:06.117539 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4cafb1d6-93ba-4c71-9211-02602e464a7f tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:06.118154 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4cafb1d6-93ba-4c71-9211-02602e464a7f tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:06.118780 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4cafb1d6-93ba-4c71-9211-02602e464a7f tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:06.119265 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4cafb1d6-93ba-4c71-9211-02602e464a7f tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:06.125231 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-c3eba706-6ef2-475c-a5b1-5e583a11c84a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 28167 microversion: 2.20 time: 4.102943 Dec 15 13:33:06.126453 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 154/316] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:33:02 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 28167 bytes in 4105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:33:06.131552 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-919738fe-41ad-42b3-8aea-bf2f7667eca6 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:06.132536 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-919738fe-41ad-42b3-8aea-bf2f7667eca6 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: d3c2da8c-7e29-48ac-9077-59bffb2c734b] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:06.151348 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-919738fe-41ad-42b3-8aea-bf2f7667eca6 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:06.152585 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-919738fe-41ad-42b3-8aea-bf2f7667eca6 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:06.153646 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-919738fe-41ad-42b3-8aea-bf2f7667eca6 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:06.154294 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-919738fe-41ad-42b3-8aea-bf2f7667eca6 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:06.344359 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-4cafb1d6-93ba-4c71-9211-02602e464a7f tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:06.351586 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-4cafb1d6-93ba-4c71-9211-02602e464a7f tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/20c19dcc-7224-44dc-8921-a03017d002d7" status: 200 len: 1317 microversion: 2.1 time: 0.246056 Dec 15 13:33:06.352163 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 163/317] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:06 2021] GET /compute/v2.1/servers/20c19dcc-7224-44dc-8921-a03017d002d7 => generated 1317 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:33:06.361648 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-919738fe-41ad-42b3-8aea-bf2f7667eca6 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:06.361931 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-86b4d111-3bff-46e6-ad67-81a275611abd tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:06.361931 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-86b4d111-3bff-46e6-ad67-81a275611abd tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:06.363556 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-919738fe-41ad-42b3-8aea-bf2f7667eca6 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b" status: 200 len: 1522 microversion: 2.1 time: 0.235781 Dec 15 13:33:06.363690 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-86b4d111-3bff-46e6-ad67-81a275611abd tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:06.364098 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-86b4d111-3bff-46e6-ad67-81a275611abd tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:06.364576 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 155/318] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:06 2021] GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:33:06.364966 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-86b4d111-3bff-46e6-ad67-81a275611abd tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:06.365527 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-86b4d111-3bff-46e6-ad67-81a275611abd tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:06.377740 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-6dcb12ac-1b68-40d7-ac6d-d5834cc62dfa req-cf63597a-caca-49cf-a4d0-0934cc5df1cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20c19dcc-7224-44dc-8921-a03017d002d7", "tag": "072e8117-2eea-4cb6-b7bd-92aa00b05e95"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:06.379432 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:33:06.379432 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: warnings.warn(msg) Dec 15 13:33:06.386390 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-6dcb12ac-1b68-40d7-ac6d-d5834cc62dfa req-cf63597a-caca-49cf-a4d0-0934cc5df1cb service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:06.386980 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-6dcb12ac-1b68-40d7-ac6d-d5834cc62dfa req-cf63597a-caca-49cf-a4d0-0934cc5df1cb service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:06.402715 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-6dcb12ac-1b68-40d7-ac6d-d5834cc62dfa req-cf63597a-caca-49cf-a4d0-0934cc5df1cb service nova] Creating event network-changed:072e8117-2eea-4cb6-b7bd-92aa00b05e95 for instance 20c19dcc-7224-44dc-8921-a03017d002d7 on hv-cinder-81322 Dec 15 13:33:06.408505 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-6dcb12ac-1b68-40d7-ac6d-d5834cc62dfa req-cf63597a-caca-49cf-a4d0-0934cc5df1cb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034237 Dec 15 13:33:06.409299 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 156/319] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:33:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:33:06.496652 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-86b4d111-3bff-46e6-ad67-81a275611abd tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed1331bcb0e4fe4a53379d1d72f650a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38faa56e5864d3aba51e1e8351e3a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:06.503960 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-86b4d111-3bff-46e6-ad67-81a275611abd tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb" status: 200 len: 1357 microversion: 2.1 time: 0.150773 Dec 15 13:33:06.504542 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 164/320] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:06 2021] GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:33:07.116758 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-4cf8be91-b964-4dbe-9363-8c9359018865 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:07.117686 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-4cf8be91-b964-4dbe-9363-8c9359018865 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:07.123575 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4cf8be91-b964-4dbe-9363-8c9359018865 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:07.124021 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4cf8be91-b964-4dbe-9363-8c9359018865 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:07.125457 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4cf8be91-b964-4dbe-9363-8c9359018865 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:07.126040 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4cf8be91-b964-4dbe-9363-8c9359018865 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:07.137692 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-77a2928e-6a3d-4ea2-9505-82b75d4e98ff tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:07.138667 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-77a2928e-6a3d-4ea2-9505-82b75d4e98ff tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:07.145093 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-77a2928e-6a3d-4ea2-9505-82b75d4e98ff tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:07.145553 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-77a2928e-6a3d-4ea2-9505-82b75d4e98ff tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:07.146349 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-77a2928e-6a3d-4ea2-9505-82b75d4e98ff tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:07.146819 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-77a2928e-6a3d-4ea2-9505-82b75d4e98ff tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:07.987767 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-77a2928e-6a3d-4ea2-9505-82b75d4e98ff tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 28167 microversion: 2.20 time: 0.853508 Dec 15 13:33:07.989101 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 165/321] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:33:07 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 28167 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:33:07.993783 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-db878c28-d840-4152-85d0-b3362a607827 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:07.994493 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-db878c28-d840-4152-85d0-b3362a607827 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 20c19dcc-7224-44dc-8921-a03017d002d7] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:08.001472 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-db878c28-d840-4152-85d0-b3362a607827 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:08.001926 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-db878c28-d840-4152-85d0-b3362a607827 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:08.002833 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-db878c28-d840-4152-85d0-b3362a607827 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:08.003318 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-db878c28-d840-4152-85d0-b3362a607827 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:08.015950 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-4cf8be91-b964-4dbe-9363-8c9359018865 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 28201 microversion: 2.1 time: 0.903039 Dec 15 13:33:08.021213 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 157/322] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:33:07 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 28201 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:33:08.023020 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-d2202592-1d6f-4894-9b1b-470418b9535c tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:08.023739 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-d2202592-1d6f-4894-9b1b-470418b9535c tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: d3c2da8c-7e29-48ac-9077-59bffb2c734b] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:08.030741 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d2202592-1d6f-4894-9b1b-470418b9535c tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:08.031957 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d2202592-1d6f-4894-9b1b-470418b9535c tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:08.032760 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d2202592-1d6f-4894-9b1b-470418b9535c tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:08.033202 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d2202592-1d6f-4894-9b1b-470418b9535c tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:08.214119 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-db878c28-d840-4152-85d0-b3362a607827 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:08.223897 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-db878c28-d840-4152-85d0-b3362a607827 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/20c19dcc-7224-44dc-8921-a03017d002d7" status: 200 len: 1317 microversion: 2.1 time: 0.233784 Dec 15 13:33:08.224549 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 166/323] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:07 2021] GET /compute/v2.1/servers/20c19dcc-7224-44dc-8921-a03017d002d7 => generated 1317 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:33:08.249149 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-27987dc0-7d7b-43fd-ab8c-c6b5c442e0ec tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:08.251253 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-27987dc0-7d7b-43fd-ab8c-c6b5c442e0ec tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:08.253696 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-d2202592-1d6f-4894-9b1b-470418b9535c tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:08.259764 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-27987dc0-7d7b-43fd-ab8c-c6b5c442e0ec tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:08.260454 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-27987dc0-7d7b-43fd-ab8c-c6b5c442e0ec tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:08.261732 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-27987dc0-7d7b-43fd-ab8c-c6b5c442e0ec tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:08.262319 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-27987dc0-7d7b-43fd-ab8c-c6b5c442e0ec tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:08.263201 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-d2202592-1d6f-4894-9b1b-470418b9535c tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b" status: 200 len: 1522 microversion: 2.1 time: 0.244162 Dec 15 13:33:08.263787 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 158/324] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:08 2021] GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:33:08.416768 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-27987dc0-7d7b-43fd-ab8c-c6b5c442e0ec tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed1331bcb0e4fe4a53379d1d72f650a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38faa56e5864d3aba51e1e8351e3a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:08.424448 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-27987dc0-7d7b-43fd-ab8c-c6b5c442e0ec tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb" status: 200 len: 1357 microversion: 2.1 time: 0.179765 Dec 15 13:33:08.425029 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 167/325] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:08 2021] GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb => generated 1357 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:33:09.000361 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-d8185e1f-e9c0-4da4-8545-9e4c4ef13072 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:09.001504 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-d8185e1f-e9c0-4da4-8545-9e4c4ef13072 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:09.008682 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d8185e1f-e9c0-4da4-8545-9e4c4ef13072 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:09.009182 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d8185e1f-e9c0-4da4-8545-9e4c4ef13072 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:09.010160 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d8185e1f-e9c0-4da4-8545-9e4c4ef13072 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:09.010686 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d8185e1f-e9c0-4da4-8545-9e4c4ef13072 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:09.028678 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-8c8c2e3d-83d1-4520-97cf-8d91bbfcb3c2 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:09.029621 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-8c8c2e3d-83d1-4520-97cf-8d91bbfcb3c2 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:09.036906 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8c8c2e3d-83d1-4520-97cf-8d91bbfcb3c2 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:09.037829 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8c8c2e3d-83d1-4520-97cf-8d91bbfcb3c2 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:09.038730 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8c8c2e3d-83d1-4520-97cf-8d91bbfcb3c2 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:09.039209 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8c8c2e3d-83d1-4520-97cf-8d91bbfcb3c2 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:09.075663 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-d8185e1f-e9c0-4da4-8545-9e4c4ef13072 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 28167 microversion: 2.20 time: 0.079795 Dec 15 13:33:09.076323 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 159/326] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:33:08 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 28167 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:33:09.107384 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-8c8c2e3d-83d1-4520-97cf-8d91bbfcb3c2 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 28201 microversion: 2.1 time: 0.082426 Dec 15 13:33:09.108002 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 168/327] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:33:09 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 28201 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:33:09.241214 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-305df768-c8df-43b1-b736-983f5d3d3d6d tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:09.241901 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-305df768-c8df-43b1-b736-983f5d3d3d6d tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 20c19dcc-7224-44dc-8921-a03017d002d7] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:09.248985 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-305df768-c8df-43b1-b736-983f5d3d3d6d tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:09.249432 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-305df768-c8df-43b1-b736-983f5d3d3d6d tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:09.250209 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-305df768-c8df-43b1-b736-983f5d3d3d6d tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:09.250692 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-305df768-c8df-43b1-b736-983f5d3d3d6d tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:09.281707 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-aa91f584-0b39-49cb-95bc-8edbdd7941ae tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:09.282444 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-aa91f584-0b39-49cb-95bc-8edbdd7941ae tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: d3c2da8c-7e29-48ac-9077-59bffb2c734b] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:09.290512 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-aa91f584-0b39-49cb-95bc-8edbdd7941ae tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:09.291056 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-aa91f584-0b39-49cb-95bc-8edbdd7941ae tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:09.291857 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-aa91f584-0b39-49cb-95bc-8edbdd7941ae tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:09.292293 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-aa91f584-0b39-49cb-95bc-8edbdd7941ae tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:09.432862 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-305df768-c8df-43b1-b736-983f5d3d3d6d tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:09.444044 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-305df768-c8df-43b1-b736-983f5d3d3d6d tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/20c19dcc-7224-44dc-8921-a03017d002d7" status: 200 len: 1317 microversion: 2.1 time: 0.206694 Dec 15 13:33:09.444740 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 160/328] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:09 2021] GET /compute/v2.1/servers/20c19dcc-7224-44dc-8921-a03017d002d7 => generated 1317 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:33:09.450895 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-415c4373-5a11-4b7d-9ded-6b82fe043654 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:09.451779 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-415c4373-5a11-4b7d-9ded-6b82fe043654 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:09.459474 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-415c4373-5a11-4b7d-9ded-6b82fe043654 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:09.460005 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-415c4373-5a11-4b7d-9ded-6b82fe043654 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:09.460930 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-415c4373-5a11-4b7d-9ded-6b82fe043654 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:09.461493 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-415c4373-5a11-4b7d-9ded-6b82fe043654 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:09.474815 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-aa91f584-0b39-49cb-95bc-8edbdd7941ae tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:09.482671 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-aa91f584-0b39-49cb-95bc-8edbdd7941ae tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b" status: 200 len: 1522 microversion: 2.1 time: 0.205329 Dec 15 13:33:09.483875 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 169/329] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:09 2021] GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:33:09.596970 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-415c4373-5a11-4b7d-9ded-6b82fe043654 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed1331bcb0e4fe4a53379d1d72f650a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38faa56e5864d3aba51e1e8351e3a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:09.604299 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-415c4373-5a11-4b7d-9ded-6b82fe043654 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb" status: 200 len: 1357 microversion: 2.1 time: 0.158395 Dec 15 13:33:09.604865 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 161/330] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:09 2021] GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:33:10.087026 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-19599904-5b7a-48a4-865b-03012508b7f4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:10.088010 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-19599904-5b7a-48a4-865b-03012508b7f4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:10.094321 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-19599904-5b7a-48a4-865b-03012508b7f4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:10.094780 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-19599904-5b7a-48a4-865b-03012508b7f4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:10.095597 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-19599904-5b7a-48a4-865b-03012508b7f4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:10.096042 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-19599904-5b7a-48a4-865b-03012508b7f4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:10.119355 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-98c34679-f2c3-42ec-a309-6181699230cf tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:10.120413 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-98c34679-f2c3-42ec-a309-6181699230cf tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:10.129776 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-98c34679-f2c3-42ec-a309-6181699230cf tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:10.130294 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-98c34679-f2c3-42ec-a309-6181699230cf tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:10.131105 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-98c34679-f2c3-42ec-a309-6181699230cf tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:10.131542 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-98c34679-f2c3-42ec-a309-6181699230cf tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:10.278351 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-98c34679-f2c3-42ec-a309-6181699230cf tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 28201 microversion: 2.1 time: 0.162466 Dec 15 13:33:10.282227 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 162/331] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:33:10 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 28201 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:33:10.287508 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-19599904-5b7a-48a4-865b-03012508b7f4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 28167 microversion: 2.20 time: 0.203718 Dec 15 13:33:10.291422 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 170/332] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:33:10 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 28167 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:33:10.461878 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-25a690ed-e503-4e85-9824-c28c2b4cb08c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:10.462685 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-25a690ed-e503-4e85-9824-c28c2b4cb08c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 20c19dcc-7224-44dc-8921-a03017d002d7] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:10.469842 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-25a690ed-e503-4e85-9824-c28c2b4cb08c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:10.470373 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-25a690ed-e503-4e85-9824-c28c2b4cb08c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:10.471265 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-25a690ed-e503-4e85-9824-c28c2b4cb08c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:10.471776 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-25a690ed-e503-4e85-9824-c28c2b4cb08c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:10.499917 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-d7e6d64b-a3d3-400f-ab1f-ef8c1e471b2e tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:10.500735 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-d7e6d64b-a3d3-400f-ab1f-ef8c1e471b2e tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: d3c2da8c-7e29-48ac-9077-59bffb2c734b] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:10.507644 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d7e6d64b-a3d3-400f-ab1f-ef8c1e471b2e tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:10.508193 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d7e6d64b-a3d3-400f-ab1f-ef8c1e471b2e tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:10.509094 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d7e6d64b-a3d3-400f-ab1f-ef8c1e471b2e tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:10.509601 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d7e6d64b-a3d3-400f-ab1f-ef8c1e471b2e tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:10.634044 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-25a690ed-e503-4e85-9824-c28c2b4cb08c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:10.641605 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-25a690ed-e503-4e85-9824-c28c2b4cb08c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/20c19dcc-7224-44dc-8921-a03017d002d7" status: 200 len: 1317 microversion: 2.1 time: 0.183671 Dec 15 13:33:10.642192 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 163/333] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:10 2021] GET /compute/v2.1/servers/20c19dcc-7224-44dc-8921-a03017d002d7 => generated 1317 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:33:10.646538 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-2568d2ae-ce9a-4140-a437-3c178114adea tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:10.647170 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-2568d2ae-ce9a-4140-a437-3c178114adea tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:10.655277 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2568d2ae-ce9a-4140-a437-3c178114adea tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:10.656321 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2568d2ae-ce9a-4140-a437-3c178114adea tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:10.657118 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2568d2ae-ce9a-4140-a437-3c178114adea tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:10.657561 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2568d2ae-ce9a-4140-a437-3c178114adea tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:10.677570 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-d7e6d64b-a3d3-400f-ab1f-ef8c1e471b2e tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:10.684979 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-d7e6d64b-a3d3-400f-ab1f-ef8c1e471b2e tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b" status: 200 len: 1522 microversion: 2.1 time: 0.189024 Dec 15 13:33:10.685496 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 171/334] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:10 2021] GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:33:10.788968 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-2568d2ae-ce9a-4140-a437-3c178114adea tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed1331bcb0e4fe4a53379d1d72f650a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38faa56e5864d3aba51e1e8351e3a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:10.797319 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-2568d2ae-ce9a-4140-a437-3c178114adea tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb" status: 200 len: 1357 microversion: 2.1 time: 0.153452 Dec 15 13:33:10.797888 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 164/335] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:10 2021] GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:33:11.289555 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-577a8bdb-daed-4908-8cd5-3832844ccb47 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:11.290387 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-577a8bdb-daed-4908-8cd5-3832844ccb47 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:11.296824 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-577a8bdb-daed-4908-8cd5-3832844ccb47 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:11.297275 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-577a8bdb-daed-4908-8cd5-3832844ccb47 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:11.298060 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-577a8bdb-daed-4908-8cd5-3832844ccb47 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:11.298311 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-6aefee47-62bd-4edd-bf72-b1923863eafb tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:11.298493 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-577a8bdb-daed-4908-8cd5-3832844ccb47 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:11.299307 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-6aefee47-62bd-4edd-bf72-b1923863eafb tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:11.305501 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6aefee47-62bd-4edd-bf72-b1923863eafb tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:11.305953 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6aefee47-62bd-4edd-bf72-b1923863eafb tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:11.306735 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6aefee47-62bd-4edd-bf72-b1923863eafb tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:11.307195 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6aefee47-62bd-4edd-bf72-b1923863eafb tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:11.362628 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-577a8bdb-daed-4908-8cd5-3832844ccb47 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 28201 microversion: 2.1 time: 0.076697 Dec 15 13:33:11.363597 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 172/336] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:33:11 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 28201 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:33:11.381297 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-6aefee47-62bd-4edd-bf72-b1923863eafb tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 28167 microversion: 2.20 time: 0.086518 Dec 15 13:33:11.381923 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 165/337] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:33:11 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 28167 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:33:11.658735 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-d7923a92-1c32-4bfe-8145-1c3d30e94736 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:11.659387 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-d7923a92-1c32-4bfe-8145-1c3d30e94736 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 20c19dcc-7224-44dc-8921-a03017d002d7] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:11.666190 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d7923a92-1c32-4bfe-8145-1c3d30e94736 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:11.666642 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d7923a92-1c32-4bfe-8145-1c3d30e94736 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:11.667445 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d7923a92-1c32-4bfe-8145-1c3d30e94736 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:11.667887 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d7923a92-1c32-4bfe-8145-1c3d30e94736 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:11.702033 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-746c10bc-bc61-4691-8400-9fb05b0512dd tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:11.702751 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-746c10bc-bc61-4691-8400-9fb05b0512dd tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: d3c2da8c-7e29-48ac-9077-59bffb2c734b] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:11.709733 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-746c10bc-bc61-4691-8400-9fb05b0512dd tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:11.710193 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-746c10bc-bc61-4691-8400-9fb05b0512dd tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:11.711033 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-746c10bc-bc61-4691-8400-9fb05b0512dd tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:11.711474 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-746c10bc-bc61-4691-8400-9fb05b0512dd tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:11.825742 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-d7923a92-1c32-4bfe-8145-1c3d30e94736 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:11.832938 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-d7923a92-1c32-4bfe-8145-1c3d30e94736 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/20c19dcc-7224-44dc-8921-a03017d002d7" status: 200 len: 1317 microversion: 2.1 time: 0.178302 Dec 15 13:33:11.833515 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 173/338] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:11 2021] GET /compute/v2.1/servers/20c19dcc-7224-44dc-8921-a03017d002d7 => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:33:11.837690 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-8033f39d-8f3c-42d0-a6e4-f987f229f722 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:11.838827 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-8033f39d-8f3c-42d0-a6e4-f987f229f722 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:11.844589 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8033f39d-8f3c-42d0-a6e4-f987f229f722 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:11.845046 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8033f39d-8f3c-42d0-a6e4-f987f229f722 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:11.845851 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8033f39d-8f3c-42d0-a6e4-f987f229f722 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:11.846292 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8033f39d-8f3c-42d0-a6e4-f987f229f722 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:11.882115 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-746c10bc-bc61-4691-8400-9fb05b0512dd tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:11.889473 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-746c10bc-bc61-4691-8400-9fb05b0512dd tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b" status: 200 len: 1522 microversion: 2.1 time: 0.191697 Dec 15 13:33:11.890078 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 166/339] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:11 2021] GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:33:11.977428 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-8033f39d-8f3c-42d0-a6e4-f987f229f722 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed1331bcb0e4fe4a53379d1d72f650a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38faa56e5864d3aba51e1e8351e3a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:11.985413 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-8033f39d-8f3c-42d0-a6e4-f987f229f722 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb" status: 200 len: 1357 microversion: 2.1 time: 0.150937 Dec 15 13:33:11.985980 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 174/340] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:11 2021] GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:33:12.373818 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-e784d81a-a40b-492d-a75d-8ef0f1f3ef02 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:12.374951 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-e784d81a-a40b-492d-a75d-8ef0f1f3ef02 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:12.381570 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e784d81a-a40b-492d-a75d-8ef0f1f3ef02 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:12.382020 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e784d81a-a40b-492d-a75d-8ef0f1f3ef02 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:12.382970 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e784d81a-a40b-492d-a75d-8ef0f1f3ef02 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:12.383407 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e784d81a-a40b-492d-a75d-8ef0f1f3ef02 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:12.393338 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-26709584-c778-4ac5-956a-324ecc2736a3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:12.394589 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-26709584-c778-4ac5-956a-324ecc2736a3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:12.402283 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-26709584-c778-4ac5-956a-324ecc2736a3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:12.403182 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-26709584-c778-4ac5-956a-324ecc2736a3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:12.404055 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-26709584-c778-4ac5-956a-324ecc2736a3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:12.404563 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-26709584-c778-4ac5-956a-324ecc2736a3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:12.455694 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-e784d81a-a40b-492d-a75d-8ef0f1f3ef02 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 28201 microversion: 2.1 time: 0.085226 Dec 15 13:33:12.456263 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 167/341] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:33:12 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 28201 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:33:12.476480 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-26709584-c778-4ac5-956a-324ecc2736a3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 28167 microversion: 2.20 time: 0.087253 Dec 15 13:33:12.480596 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 175/342] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:33:12 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 28167 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:33:12.850424 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-727ab00e-8ff1-4bcd-8ba7-5e46260fa01c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:12.851271 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-727ab00e-8ff1-4bcd-8ba7-5e46260fa01c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 20c19dcc-7224-44dc-8921-a03017d002d7] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:12.858864 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-727ab00e-8ff1-4bcd-8ba7-5e46260fa01c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:12.859323 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-727ab00e-8ff1-4bcd-8ba7-5e46260fa01c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:12.860139 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-727ab00e-8ff1-4bcd-8ba7-5e46260fa01c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:12.860602 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-727ab00e-8ff1-4bcd-8ba7-5e46260fa01c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:12.908944 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-acb9c95d-c5c7-4a6e-adb7-86c3b1baff52 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:12.909689 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-acb9c95d-c5c7-4a6e-adb7-86c3b1baff52 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: d3c2da8c-7e29-48ac-9077-59bffb2c734b] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:12.916690 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-acb9c95d-c5c7-4a6e-adb7-86c3b1baff52 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:12.917150 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-acb9c95d-c5c7-4a6e-adb7-86c3b1baff52 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:12.917946 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-acb9c95d-c5c7-4a6e-adb7-86c3b1baff52 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:12.918392 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-acb9c95d-c5c7-4a6e-adb7-86c3b1baff52 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:13.036799 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-727ab00e-8ff1-4bcd-8ba7-5e46260fa01c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:13.044269 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-727ab00e-8ff1-4bcd-8ba7-5e46260fa01c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/20c19dcc-7224-44dc-8921-a03017d002d7" status: 200 len: 1317 microversion: 2.1 time: 0.198219 Dec 15 13:33:13.044931 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 168/343] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:12 2021] GET /compute/v2.1/servers/20c19dcc-7224-44dc-8921-a03017d002d7 => generated 1317 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:33:13.049702 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-e51357ef-79d6-4363-ac7c-c07152a0f096 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:13.050387 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-e51357ef-79d6-4363-ac7c-c07152a0f096 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:13.056112 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e51357ef-79d6-4363-ac7c-c07152a0f096 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:13.056558 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e51357ef-79d6-4363-ac7c-c07152a0f096 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:13.057338 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e51357ef-79d6-4363-ac7c-c07152a0f096 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:13.057772 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e51357ef-79d6-4363-ac7c-c07152a0f096 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:13.082909 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-acb9c95d-c5c7-4a6e-adb7-86c3b1baff52 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:13.090223 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-acb9c95d-c5c7-4a6e-adb7-86c3b1baff52 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b" status: 200 len: 1502 microversion: 2.1 time: 0.187601 Dec 15 13:33:13.090806 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 176/344] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:12 2021] GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b => generated 1502 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:33:13.105806 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-e29cf39c-8e13-4b4d-8af9-34bf0bc7b839 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:13.107172 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-e29cf39c-8e13-4b4d-8af9-34bf0bc7b839 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:13.113719 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e29cf39c-8e13-4b4d-8af9-34bf0bc7b839 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:13.114382 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e29cf39c-8e13-4b4d-8af9-34bf0bc7b839 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:13.116023 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e29cf39c-8e13-4b4d-8af9-34bf0bc7b839 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:13.116537 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e29cf39c-8e13-4b4d-8af9-34bf0bc7b839 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:13.221380 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-e51357ef-79d6-4363-ac7c-c07152a0f096 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed1331bcb0e4fe4a53379d1d72f650a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38faa56e5864d3aba51e1e8351e3a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:13.229976 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-e51357ef-79d6-4363-ac7c-c07152a0f096 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb" status: 200 len: 1357 microversion: 2.1 time: 0.183805 Dec 15 13:33:13.230600 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 169/345] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:13 2021] GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb => generated 1357 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:33:13.283468 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-e29cf39c-8e13-4b4d-8af9-34bf0bc7b839 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:13.291339 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-e29cf39c-8e13-4b4d-8af9-34bf0bc7b839 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a" status: 200 len: 1515 microversion: 2.1 time: 0.189145 Dec 15 13:33:13.291918 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 177/346] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:13 2021] GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a => generated 1515 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:33:13.467727 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-fdb23210-9313-4e56-96da-03a84d8646a5 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:13.469290 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-fdb23210-9313-4e56-96da-03a84d8646a5 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:13.475727 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-fdb23210-9313-4e56-96da-03a84d8646a5 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:13.476185 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-fdb23210-9313-4e56-96da-03a84d8646a5 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:13.477175 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-fdb23210-9313-4e56-96da-03a84d8646a5 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:13.477621 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-fdb23210-9313-4e56-96da-03a84d8646a5 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:13.488954 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-922d5bc9-f013-4c6d-a9af-4c7fb9b0797b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:13.490448 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-922d5bc9-f013-4c6d-a9af-4c7fb9b0797b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:13.497792 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-922d5bc9-f013-4c6d-a9af-4c7fb9b0797b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:13.498868 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-922d5bc9-f013-4c6d-a9af-4c7fb9b0797b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:13.500099 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-922d5bc9-f013-4c6d-a9af-4c7fb9b0797b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:13.500638 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-922d5bc9-f013-4c6d-a9af-4c7fb9b0797b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:13.564999 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-fdb23210-9313-4e56-96da-03a84d8646a5 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 28201 microversion: 2.1 time: 0.100988 Dec 15 13:33:13.566663 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 170/347] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:33:13 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 28201 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:33:13.682341 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-922d5bc9-f013-4c6d-a9af-4c7fb9b0797b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 28167 microversion: 2.20 time: 0.196976 Dec 15 13:33:13.683048 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 178/348] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:33:13 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 28167 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:33:14.062361 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-db4de5e5-45c5-42ea-82a0-f49163ffb006 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:14.063094 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-db4de5e5-45c5-42ea-82a0-f49163ffb006 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 20c19dcc-7224-44dc-8921-a03017d002d7] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:14.069549 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-db4de5e5-45c5-42ea-82a0-f49163ffb006 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:14.069998 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-db4de5e5-45c5-42ea-82a0-f49163ffb006 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:14.070772 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-db4de5e5-45c5-42ea-82a0-f49163ffb006 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:14.071233 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-db4de5e5-45c5-42ea-82a0-f49163ffb006 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:14.197574 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-db4de5e5-45c5-42ea-82a0-f49163ffb006 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:14.205977 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-db4de5e5-45c5-42ea-82a0-f49163ffb006 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/20c19dcc-7224-44dc-8921-a03017d002d7" status: 200 len: 1317 microversion: 2.1 time: 0.148146 Dec 15 13:33:14.206551 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 171/349] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:14 2021] GET /compute/v2.1/servers/20c19dcc-7224-44dc-8921-a03017d002d7 => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:33:14.246519 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ac85eb20-bd60-4ceb-9b74-0bd2ae4b0efa tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:14.247248 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ac85eb20-bd60-4ceb-9b74-0bd2ae4b0efa tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:14.254880 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ac85eb20-bd60-4ceb-9b74-0bd2ae4b0efa tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:14.255337 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ac85eb20-bd60-4ceb-9b74-0bd2ae4b0efa tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:14.256114 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ac85eb20-bd60-4ceb-9b74-0bd2ae4b0efa tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:14.256551 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ac85eb20-bd60-4ceb-9b74-0bd2ae4b0efa tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:14.393106 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-ac85eb20-bd60-4ceb-9b74-0bd2ae4b0efa tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed1331bcb0e4fe4a53379d1d72f650a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38faa56e5864d3aba51e1e8351e3a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:14.400788 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ac85eb20-bd60-4ceb-9b74-0bd2ae4b0efa tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb" status: 200 len: 1357 microversion: 2.1 time: 0.158172 Dec 15 13:33:14.401614 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 179/350] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:14 2021] GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:33:14.577449 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-1f70ab61-dbfd-47ff-92de-b469d46d2f0a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:14.578366 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-1f70ab61-dbfd-47ff-92de-b469d46d2f0a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:14.584987 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1f70ab61-dbfd-47ff-92de-b469d46d2f0a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:14.585376 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1f70ab61-dbfd-47ff-92de-b469d46d2f0a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:14.586153 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1f70ab61-dbfd-47ff-92de-b469d46d2f0a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:14.586587 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1f70ab61-dbfd-47ff-92de-b469d46d2f0a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:14.693695 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-c182e44a-0293-4c5e-bf3c-d5d6ac7b2162 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:14.695247 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-c182e44a-0293-4c5e-bf3c-d5d6ac7b2162 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:14.702012 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c182e44a-0293-4c5e-bf3c-d5d6ac7b2162 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:14.702504 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c182e44a-0293-4c5e-bf3c-d5d6ac7b2162 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:14.703446 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c182e44a-0293-4c5e-bf3c-d5d6ac7b2162 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:14.703893 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c182e44a-0293-4c5e-bf3c-d5d6ac7b2162 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:18.122685 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-c182e44a-0293-4c5e-bf3c-d5d6ac7b2162 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 28167 microversion: 2.20 time: 3.432552 Dec 15 13:33:18.123674 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 180/351] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:33:14 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 28167 bytes in 3434 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:33:18.128705 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-1f70ab61-dbfd-47ff-92de-b469d46d2f0a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 28201 microversion: 2.1 time: 3.555038 Dec 15 13:33:18.129122 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-98967e58-3382-475b-9942-b93830baaa53 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:18.129491 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-98967e58-3382-475b-9942-b93830baaa53 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 20c19dcc-7224-44dc-8921-a03017d002d7] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:18.129732 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 172/352] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:33:14 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 28201 bytes in 3557 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:33:18.135873 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-d1001b37-ca74-4ac7-9441-9e1aaed3b347 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:18.136342 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-98967e58-3382-475b-9942-b93830baaa53 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:18.136565 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-d1001b37-ca74-4ac7-9441-9e1aaed3b347 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:18.136796 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-98967e58-3382-475b-9942-b93830baaa53 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:18.137582 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-98967e58-3382-475b-9942-b93830baaa53 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:18.138036 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-98967e58-3382-475b-9942-b93830baaa53 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:18.143614 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d1001b37-ca74-4ac7-9441-9e1aaed3b347 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:18.144058 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d1001b37-ca74-4ac7-9441-9e1aaed3b347 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:18.144837 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d1001b37-ca74-4ac7-9441-9e1aaed3b347 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:18.145271 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d1001b37-ca74-4ac7-9441-9e1aaed3b347 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:18.326918 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-98967e58-3382-475b-9942-b93830baaa53 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:18.330065 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-d1001b37-ca74-4ac7-9441-9e1aaed3b347 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed1331bcb0e4fe4a53379d1d72f650a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38faa56e5864d3aba51e1e8351e3a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:18.334162 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-98967e58-3382-475b-9942-b93830baaa53 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/20c19dcc-7224-44dc-8921-a03017d002d7" status: 200 len: 1317 microversion: 2.1 time: 0.209611 Dec 15 13:33:18.334739 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 181/353] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:18 2021] GET /compute/v2.1/servers/20c19dcc-7224-44dc-8921-a03017d002d7 => generated 1317 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:33:18.337392 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-d1001b37-ca74-4ac7-9441-9e1aaed3b347 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb" status: 200 len: 1357 microversion: 2.1 time: 0.206599 Dec 15 13:33:18.337950 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 173/354] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:18 2021] GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb => generated 1357 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:33:19.134717 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-6de2cd4b-108c-4321-a26e-633796c22981 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:19.135663 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-6de2cd4b-108c-4321-a26e-633796c22981 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:19.139774 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-1d9a42c5-a492-45ec-b426-4e5d08ebc052 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:19.140682 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-1d9a42c5-a492-45ec-b426-4e5d08ebc052 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:19.142454 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6de2cd4b-108c-4321-a26e-633796c22981 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:19.142964 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6de2cd4b-108c-4321-a26e-633796c22981 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:19.143757 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6de2cd4b-108c-4321-a26e-633796c22981 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:19.144193 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6de2cd4b-108c-4321-a26e-633796c22981 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:19.147334 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1d9a42c5-a492-45ec-b426-4e5d08ebc052 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:19.147779 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1d9a42c5-a492-45ec-b426-4e5d08ebc052 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:19.148558 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1d9a42c5-a492-45ec-b426-4e5d08ebc052 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:19.148989 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1d9a42c5-a492-45ec-b426-4e5d08ebc052 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:19.216457 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-6de2cd4b-108c-4321-a26e-633796c22981 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 28167 microversion: 2.20 time: 0.085254 Dec 15 13:33:19.217387 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 182/355] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:33:19 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 28167 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:33:19.228001 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-1d9a42c5-a492-45ec-b426-4e5d08ebc052 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 28201 microversion: 2.1 time: 0.091675 Dec 15 13:33:19.228630 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 174/356] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:33:19 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 28201 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:33:19.351713 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-a5e56dab-3fa9-4eed-af97-1b2d0e83d6f0 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:19.352601 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-a5e56dab-3fa9-4eed-af97-1b2d0e83d6f0 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 20c19dcc-7224-44dc-8921-a03017d002d7] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:19.354022 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-3a23ac4c-ffb1-4a44-b8a8-5ae1216a6090 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:19.354977 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-3a23ac4c-ffb1-4a44-b8a8-5ae1216a6090 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:19.359784 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a5e56dab-3fa9-4eed-af97-1b2d0e83d6f0 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:19.360242 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a5e56dab-3fa9-4eed-af97-1b2d0e83d6f0 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:19.361027 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a5e56dab-3fa9-4eed-af97-1b2d0e83d6f0 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:19.361630 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a5e56dab-3fa9-4eed-af97-1b2d0e83d6f0 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:19.362614 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3a23ac4c-ffb1-4a44-b8a8-5ae1216a6090 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:19.363103 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3a23ac4c-ffb1-4a44-b8a8-5ae1216a6090 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:19.363897 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3a23ac4c-ffb1-4a44-b8a8-5ae1216a6090 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:19.364402 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3a23ac4c-ffb1-4a44-b8a8-5ae1216a6090 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:19.554687 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-a5e56dab-3fa9-4eed-af97-1b2d0e83d6f0 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:19.558032 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-3a23ac4c-ffb1-4a44-b8a8-5ae1216a6090 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed1331bcb0e4fe4a53379d1d72f650a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38faa56e5864d3aba51e1e8351e3a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:19.562140 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-a5e56dab-3fa9-4eed-af97-1b2d0e83d6f0 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/20c19dcc-7224-44dc-8921-a03017d002d7" status: 200 len: 1317 microversion: 2.1 time: 0.214637 Dec 15 13:33:19.562715 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 183/357] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:19 2021] GET /compute/v2.1/servers/20c19dcc-7224-44dc-8921-a03017d002d7 => generated 1317 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:33:19.565657 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-3a23ac4c-ffb1-4a44-b8a8-5ae1216a6090 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb" status: 200 len: 1357 microversion: 2.1 time: 0.215711 Dec 15 13:33:19.566212 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 175/358] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:19 2021] GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb => generated 1357 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:33:19.889719 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-faffdfa8-23e1-4d13-901f-ef7e736e5429 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:19.890651 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-faffdfa8-23e1-4d13-901f-ef7e736e5429 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:19.897310 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-faffdfa8-23e1-4d13-901f-ef7e736e5429 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:19.897758 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-faffdfa8-23e1-4d13-901f-ef7e736e5429 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:19.898530 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-faffdfa8-23e1-4d13-901f-ef7e736e5429 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:19.899008 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-faffdfa8-23e1-4d13-901f-ef7e736e5429 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:19.923664 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.objects.instance [None req-faffdfa8-23e1-4d13-901f-ef7e736e5429 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lazy-loading 'flavor' on Instance uuid eab2a5ce-9a56-4120-ae3c-ddfb844aa30a {{(pid=116942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:33:19.992355 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-faffdfa8-23e1-4d13-901f-ef7e736e5429 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "POST /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a/action" status: 200 len: 32 microversion: 2.1 time: 0.106194 Dec 15 13:33:19.992966 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 184/359] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:33:19 2021] POST /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a/action => generated 32 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:33:20.002010 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-5b4be90f-ae73-4600-869e-013942ca7bd7 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:20.002628 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-5b4be90f-ae73-4600-869e-013942ca7bd7 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:20.008990 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5b4be90f-ae73-4600-869e-013942ca7bd7 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:20.009442 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5b4be90f-ae73-4600-869e-013942ca7bd7 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:20.010225 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5b4be90f-ae73-4600-869e-013942ca7bd7 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:20.010674 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5b4be90f-ae73-4600-869e-013942ca7bd7 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:20.167845 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-5b4be90f-ae73-4600-869e-013942ca7bd7 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:20.175647 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-5b4be90f-ae73-4600-869e-013942ca7bd7 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a" status: 200 len: 1521 microversion: 2.1 time: 0.177148 Dec 15 13:33:20.177188 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 176/360] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:19 2021] GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:33:20.229858 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-74356748-702b-4db7-ab14-ea6214b7cdf5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:20.231692 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-74356748-702b-4db7-ab14-ea6214b7cdf5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:20.240947 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-a9fafdf4-55e6-4f40-b502-0df26599f706 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:20.242540 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-a9fafdf4-55e6-4f40-b502-0df26599f706 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:20.252084 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-74356748-702b-4db7-ab14-ea6214b7cdf5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:20.252537 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-74356748-702b-4db7-ab14-ea6214b7cdf5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:20.253340 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-74356748-702b-4db7-ab14-ea6214b7cdf5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:20.253769 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-74356748-702b-4db7-ab14-ea6214b7cdf5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:20.260639 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a9fafdf4-55e6-4f40-b502-0df26599f706 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:20.261090 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a9fafdf4-55e6-4f40-b502-0df26599f706 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:20.261890 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a9fafdf4-55e6-4f40-b502-0df26599f706 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:20.262322 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a9fafdf4-55e6-4f40-b502-0df26599f706 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:20.357313 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-a9fafdf4-55e6-4f40-b502-0df26599f706 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 28201 microversion: 2.1 time: 0.121205 Dec 15 13:33:20.358035 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 177/361] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:33:20 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 28201 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:33:20.364098 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-efab7c53-05b6-4154-a77a-62cc221b67ba req-bf7019fe-bd1f-4620-8266-e13b329279d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20c19dcc-7224-44dc-8921-a03017d002d7", "name": "network-vif-plugged", "status": "completed", "tag": "072e8117-2eea-4cb6-b7bd-92aa00b05e95"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:20.365785 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:33:20.365785 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: warnings.warn(msg) Dec 15 13:33:20.374438 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-efab7c53-05b6-4154-a77a-62cc221b67ba req-bf7019fe-bd1f-4620-8266-e13b329279d7 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:20.375123 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-efab7c53-05b6-4154-a77a-62cc221b67ba req-bf7019fe-bd1f-4620-8266-e13b329279d7 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:20.377388 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-74356748-702b-4db7-ab14-ea6214b7cdf5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 28420 microversion: 2.20 time: 0.151954 Dec 15 13:33:20.384769 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 185/362] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:33:20 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 28420 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:33:20.397185 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-efab7c53-05b6-4154-a77a-62cc221b67ba req-bf7019fe-bd1f-4620-8266-e13b329279d7 service nova] Creating event network-vif-plugged:072e8117-2eea-4cb6-b7bd-92aa00b05e95 for instance 20c19dcc-7224-44dc-8921-a03017d002d7 on hv-cinder-81322 Dec 15 13:33:20.402794 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-efab7c53-05b6-4154-a77a-62cc221b67ba req-bf7019fe-bd1f-4620-8266-e13b329279d7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042996 Dec 15 13:33:20.403629 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 178/363] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:33:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:33:20.583728 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-46d5c0b2-6ecf-402e-b112-e8fcf59a4a7e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:20.584547 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-46d5c0b2-6ecf-402e-b112-e8fcf59a4a7e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 20c19dcc-7224-44dc-8921-a03017d002d7] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:20.586534 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-cadc0ffa-6f6d-4999-bad5-afebee73b87b tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:20.587919 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-cadc0ffa-6f6d-4999-bad5-afebee73b87b tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:20.597727 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cadc0ffa-6f6d-4999-bad5-afebee73b87b tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:20.598447 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cadc0ffa-6f6d-4999-bad5-afebee73b87b tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:20.599735 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cadc0ffa-6f6d-4999-bad5-afebee73b87b tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:20.600077 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-46d5c0b2-6ecf-402e-b112-e8fcf59a4a7e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:20.600534 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-46d5c0b2-6ecf-402e-b112-e8fcf59a4a7e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:20.600764 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cadc0ffa-6f6d-4999-bad5-afebee73b87b tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:20.604842 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-46d5c0b2-6ecf-402e-b112-e8fcf59a4a7e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:20.605302 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-46d5c0b2-6ecf-402e-b112-e8fcf59a4a7e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:20.838710 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-cadc0ffa-6f6d-4999-bad5-afebee73b87b tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed1331bcb0e4fe4a53379d1d72f650a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38faa56e5864d3aba51e1e8351e3a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:20.843006 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-46d5c0b2-6ecf-402e-b112-e8fcf59a4a7e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:20.846114 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-cadc0ffa-6f6d-4999-bad5-afebee73b87b tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb" status: 200 len: 1357 microversion: 2.1 time: 0.266914 Dec 15 13:33:20.846692 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 179/364] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:20 2021] GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb => generated 1357 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:33:20.850236 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-46d5c0b2-6ecf-402e-b112-e8fcf59a4a7e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/20c19dcc-7224-44dc-8921-a03017d002d7" status: 200 len: 1317 microversion: 2.1 time: 0.273194 Dec 15 13:33:20.850793 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 186/365] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:20 2021] GET /compute/v2.1/servers/20c19dcc-7224-44dc-8921-a03017d002d7 => generated 1317 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:33:21.193404 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-f9bb722b-10a5-492a-bbb3-c01b41c3878c tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:21.193927 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-f9bb722b-10a5-492a-bbb3-c01b41c3878c tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:21.200377 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f9bb722b-10a5-492a-bbb3-c01b41c3878c tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:21.200828 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f9bb722b-10a5-492a-bbb3-c01b41c3878c tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:21.201599 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f9bb722b-10a5-492a-bbb3-c01b41c3878c tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:21.202029 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f9bb722b-10a5-492a-bbb3-c01b41c3878c tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:21.331341 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-f9bb722b-10a5-492a-bbb3-c01b41c3878c tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:21.338592 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-f9bb722b-10a5-492a-bbb3-c01b41c3878c tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a" status: 200 len: 1521 microversion: 2.1 time: 0.148951 Dec 15 13:33:21.339187 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 180/366] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:21 2021] GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:33:21.369151 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-42e4af41-167b-4dd0-8355-09dac0c374c3 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:21.370059 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-42e4af41-167b-4dd0-8355-09dac0c374c3 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:21.376300 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-42e4af41-167b-4dd0-8355-09dac0c374c3 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:21.376753 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-42e4af41-167b-4dd0-8355-09dac0c374c3 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:21.377535 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-42e4af41-167b-4dd0-8355-09dac0c374c3 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:21.377977 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-42e4af41-167b-4dd0-8355-09dac0c374c3 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:21.392548 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-d91afc95-fb3a-47ea-9ed4-75991afb9add tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:21.393454 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-d91afc95-fb3a-47ea-9ed4-75991afb9add tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:21.400093 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d91afc95-fb3a-47ea-9ed4-75991afb9add tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:21.400842 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d91afc95-fb3a-47ea-9ed4-75991afb9add tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:21.401812 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d91afc95-fb3a-47ea-9ed4-75991afb9add tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:21.402262 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d91afc95-fb3a-47ea-9ed4-75991afb9add tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:21.461063 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-42e4af41-167b-4dd0-8355-09dac0c374c3 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 28454 microversion: 2.1 time: 0.095270 Dec 15 13:33:21.465193 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 187/367] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:33:21 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 28454 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:33:21.493408 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-d91afc95-fb3a-47ea-9ed4-75991afb9add tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 28458 microversion: 2.20 time: 0.104750 Dec 15 13:33:21.497233 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 181/368] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:33:21 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 28458 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:33:21.865442 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-e50dd7f1-85e6-4fd7-96f8-5d107f87e597 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:21.866283 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-e50dd7f1-85e6-4fd7-96f8-5d107f87e597 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:21.867307 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-16e5af49-8ade-403f-ba33-f60ecb08c697 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:21.868209 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-16e5af49-8ade-403f-ba33-f60ecb08c697 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 20c19dcc-7224-44dc-8921-a03017d002d7] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:21.873418 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e50dd7f1-85e6-4fd7-96f8-5d107f87e597 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:21.873942 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e50dd7f1-85e6-4fd7-96f8-5d107f87e597 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:21.874821 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e50dd7f1-85e6-4fd7-96f8-5d107f87e597 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:21.875350 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e50dd7f1-85e6-4fd7-96f8-5d107f87e597 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:21.875485 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-16e5af49-8ade-403f-ba33-f60ecb08c697 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:21.875992 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-16e5af49-8ade-403f-ba33-f60ecb08c697 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:21.876862 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-16e5af49-8ade-403f-ba33-f60ecb08c697 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:21.877360 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-16e5af49-8ade-403f-ba33-f60ecb08c697 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:22.246612 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-16e5af49-8ade-403f-ba33-f60ecb08c697 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:22.250994 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-e50dd7f1-85e6-4fd7-96f8-5d107f87e597 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed1331bcb0e4fe4a53379d1d72f650a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38faa56e5864d3aba51e1e8351e3a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:22.254187 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-16e5af49-8ade-403f-ba33-f60ecb08c697 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/20c19dcc-7224-44dc-8921-a03017d002d7" status: 200 len: 1317 microversion: 2.1 time: 0.391550 Dec 15 13:33:22.254772 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 182/369] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:21 2021] GET /compute/v2.1/servers/20c19dcc-7224-44dc-8921-a03017d002d7 => generated 1317 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:33:22.263679 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-e50dd7f1-85e6-4fd7-96f8-5d107f87e597 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb" status: 200 len: 1357 microversion: 2.1 time: 0.404140 Dec 15 13:33:22.264250 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 188/370] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:21 2021] GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb => generated 1357 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:33:22.364743 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-90ac4e08-dd90-41f7-8363-4bda6c1e47c5 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:22.365373 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-90ac4e08-dd90-41f7-8363-4bda6c1e47c5 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:22.379994 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-90ac4e08-dd90-41f7-8363-4bda6c1e47c5 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:22.380499 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-90ac4e08-dd90-41f7-8363-4bda6c1e47c5 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:22.381306 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-90ac4e08-dd90-41f7-8363-4bda6c1e47c5 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:22.381738 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-90ac4e08-dd90-41f7-8363-4bda6c1e47c5 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:22.428830 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-e44921f5-8dc8-4cbd-9ef5-1e2aaa98397a req-9d164aab-a9a3-4bf9-ac76-e0598b4dfd5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f21e20b-c80e-408b-849e-cf9e27127cbb", "name": "network-vif-plugged", "status": "completed", "tag": "f90cb0df-c11c-44a8-b09b-274188bbac57"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:22.430353 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:33:22.430353 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: warnings.warn(msg) Dec 15 13:33:22.441628 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-e44921f5-8dc8-4cbd-9ef5-1e2aaa98397a req-9d164aab-a9a3-4bf9-ac76-e0598b4dfd5e service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:22.442208 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-e44921f5-8dc8-4cbd-9ef5-1e2aaa98397a req-9d164aab-a9a3-4bf9-ac76-e0598b4dfd5e service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:22.454079 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-e44921f5-8dc8-4cbd-9ef5-1e2aaa98397a req-9d164aab-a9a3-4bf9-ac76-e0598b4dfd5e service nova] Creating event network-vif-plugged:f90cb0df-c11c-44a8-b09b-274188bbac57 for instance 9f21e20b-c80e-408b-849e-cf9e27127cbb on hv-cinder-81322 Dec 15 13:33:22.459258 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-e44921f5-8dc8-4cbd-9ef5-1e2aaa98397a req-9d164aab-a9a3-4bf9-ac76-e0598b4dfd5e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033938 Dec 15 13:33:22.459862 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 189/371] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:33:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:33:22.473518 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-a0322e60-0811-4bd2-b11f-35f637965508 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:22.474692 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-a0322e60-0811-4bd2-b11f-35f637965508 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:22.482696 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a0322e60-0811-4bd2-b11f-35f637965508 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:22.483194 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a0322e60-0811-4bd2-b11f-35f637965508 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:22.483987 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a0322e60-0811-4bd2-b11f-35f637965508 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:22.485315 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a0322e60-0811-4bd2-b11f-35f637965508 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:22.533140 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-90ac4e08-dd90-41f7-8363-4bda6c1e47c5 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:22.540670 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-90ac4e08-dd90-41f7-8363-4bda6c1e47c5 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a" status: 200 len: 1521 microversion: 2.1 time: 0.187833 Dec 15 13:33:22.541248 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 183/372] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:22 2021] GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:33:22.545720 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-52124eef-4eb4-4c81-9723-d92a2d875335 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:22.546677 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-52124eef-4eb4-4c81-9723-d92a2d875335 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:22.552347 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-52124eef-4eb4-4c81-9723-d92a2d875335 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:22.552808 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-52124eef-4eb4-4c81-9723-d92a2d875335 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:22.553597 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-52124eef-4eb4-4c81-9723-d92a2d875335 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:22.554032 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-52124eef-4eb4-4c81-9723-d92a2d875335 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:22.596604 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-a0322e60-0811-4bd2-b11f-35f637965508 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 28492 microversion: 2.1 time: 0.127225 Dec 15 13:33:22.597266 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 190/373] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:33:22 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 28492 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:33:22.642359 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-52124eef-4eb4-4c81-9723-d92a2d875335 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 28458 microversion: 2.20 time: 0.098909 Dec 15 13:33:22.646023 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 184/374] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:33:22 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 28458 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:33:23.272142 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-5e89d1b7-c69b-4a88-b2e5-7db70c6e8d1b tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:23.272967 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-5e89d1b7-c69b-4a88-b2e5-7db70c6e8d1b tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 20c19dcc-7224-44dc-8921-a03017d002d7] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:23.283369 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5e89d1b7-c69b-4a88-b2e5-7db70c6e8d1b tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:23.284149 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5e89d1b7-c69b-4a88-b2e5-7db70c6e8d1b tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:23.284528 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-13f144f7-ab49-44a4-ae64-1dd7aed45da1 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:23.285019 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5e89d1b7-c69b-4a88-b2e5-7db70c6e8d1b tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:23.285370 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-13f144f7-ab49-44a4-ae64-1dd7aed45da1 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:23.285724 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5e89d1b7-c69b-4a88-b2e5-7db70c6e8d1b tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:23.292441 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-13f144f7-ab49-44a4-ae64-1dd7aed45da1 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:23.293141 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-13f144f7-ab49-44a4-ae64-1dd7aed45da1 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:23.293939 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-13f144f7-ab49-44a4-ae64-1dd7aed45da1 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:23.294382 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-13f144f7-ab49-44a4-ae64-1dd7aed45da1 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:23.490153 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-13f144f7-ab49-44a4-ae64-1dd7aed45da1 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed1331bcb0e4fe4a53379d1d72f650a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38faa56e5864d3aba51e1e8351e3a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:23.493287 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-5e89d1b7-c69b-4a88-b2e5-7db70c6e8d1b tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:23.498584 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-13f144f7-ab49-44a4-ae64-1dd7aed45da1 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb" status: 200 len: 1357 microversion: 2.1 time: 0.217986 Dec 15 13:33:23.499905 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 185/375] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:23 2021] GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb => generated 1357 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:33:23.501738 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-5e89d1b7-c69b-4a88-b2e5-7db70c6e8d1b tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/20c19dcc-7224-44dc-8921-a03017d002d7" status: 200 len: 1507 microversion: 2.1 time: 0.234042 Dec 15 13:33:23.502481 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 191/376] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:23 2021] GET /compute/v2.1/servers/20c19dcc-7224-44dc-8921-a03017d002d7 => generated 1507 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:33:23.557077 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-70f68014-7dd9-44a1-83b0-7ac4f54862dd tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:23.557863 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-70f68014-7dd9-44a1-83b0-7ac4f54862dd tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:23.565229 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-70f68014-7dd9-44a1-83b0-7ac4f54862dd tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:23.565680 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-70f68014-7dd9-44a1-83b0-7ac4f54862dd tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:23.566467 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-70f68014-7dd9-44a1-83b0-7ac4f54862dd tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:23.566924 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-70f68014-7dd9-44a1-83b0-7ac4f54862dd tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:23.608435 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-20b71035-ab7a-4bf7-861c-b7776f321e8c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:23.610174 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-20b71035-ab7a-4bf7-861c-b7776f321e8c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:23.616876 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-20b71035-ab7a-4bf7-861c-b7776f321e8c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:23.617696 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-20b71035-ab7a-4bf7-861c-b7776f321e8c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:23.618822 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-20b71035-ab7a-4bf7-861c-b7776f321e8c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:23.619769 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-20b71035-ab7a-4bf7-861c-b7776f321e8c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:23.739810 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-70f68014-7dd9-44a1-83b0-7ac4f54862dd tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:23.751531 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-70f68014-7dd9-44a1-83b0-7ac4f54862dd tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a" status: 200 len: 1521 microversion: 2.1 time: 0.197932 Dec 15 13:33:23.753264 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 186/377] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:23 2021] GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:33:23.758609 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-424abd91-d74c-433e-9429-76d592f748f2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:23.759938 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-424abd91-d74c-433e-9429-76d592f748f2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:23.771390 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-424abd91-d74c-433e-9429-76d592f748f2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:23.772029 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-424abd91-d74c-433e-9429-76d592f748f2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:23.773144 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-424abd91-d74c-433e-9429-76d592f748f2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:23.773911 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-424abd91-d74c-433e-9429-76d592f748f2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:23.803222 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-20b71035-ab7a-4bf7-861c-b7776f321e8c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 28542 microversion: 2.1 time: 0.191248 Dec 15 13:33:23.803222 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 192/378] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:33:23 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 28542 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:33:23.926691 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-424abd91-d74c-433e-9429-76d592f748f2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 28625 microversion: 2.20 time: 0.171819 Dec 15 13:33:23.927463 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 187/379] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:33:23 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 28625 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:33:24.519414 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-b3390ce9-0d34-4958-98fb-b5aed903d098 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:24.520675 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-b3390ce9-0d34-4958-98fb-b5aed903d098 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:24.528423 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b3390ce9-0d34-4958-98fb-b5aed903d098 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:24.529574 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b3390ce9-0d34-4958-98fb-b5aed903d098 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:24.530788 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b3390ce9-0d34-4958-98fb-b5aed903d098 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:24.534370 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b3390ce9-0d34-4958-98fb-b5aed903d098 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:24.672378 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-b3390ce9-0d34-4958-98fb-b5aed903d098 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed1331bcb0e4fe4a53379d1d72f650a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38faa56e5864d3aba51e1e8351e3a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:24.679737 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-b3390ce9-0d34-4958-98fb-b5aed903d098 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb" status: 200 len: 1547 microversion: 2.1 time: 0.166257 Dec 15 13:33:24.680354 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 193/380] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:24 2021] GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb => generated 1547 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:33:24.697925 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-8729f633-f323-4a61-8951-3b09b7a6450c tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:24.698627 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-8729f633-f323-4a61-8951-3b09b7a6450c tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:24.706171 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8729f633-f323-4a61-8951-3b09b7a6450c tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:24.706618 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8729f633-f323-4a61-8951-3b09b7a6450c tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:24.707422 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8729f633-f323-4a61-8951-3b09b7a6450c tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:24.707851 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8729f633-f323-4a61-8951-3b09b7a6450c tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:24.769757 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-77035183-9106-427d-a11a-6f35eb77a0c5 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:24.770429 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-77035183-9106-427d-a11a-6f35eb77a0c5 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:24.776220 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-77035183-9106-427d-a11a-6f35eb77a0c5 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:24.776677 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-77035183-9106-427d-a11a-6f35eb77a0c5 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:24.777457 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-77035183-9106-427d-a11a-6f35eb77a0c5 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:24.777920 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-77035183-9106-427d-a11a-6f35eb77a0c5 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:24.871968 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-8729f633-f323-4a61-8951-3b09b7a6450c tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed1331bcb0e4fe4a53379d1d72f650a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38faa56e5864d3aba51e1e8351e3a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:24.879734 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-8729f633-f323-4a61-8951-3b09b7a6450c tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb" status: 200 len: 1547 microversion: 2.1 time: 0.186373 Dec 15 13:33:24.880311 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 188/381] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:24 2021] GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb => generated 1547 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:33:24.884788 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-eadc6607-3d66-4d26-b31e-0b5e18fdeb1e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:24.885713 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-eadc6607-3d66-4d26-b31e-0b5e18fdeb1e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:24.892329 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-eadc6607-3d66-4d26-b31e-0b5e18fdeb1e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:24.892779 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-eadc6607-3d66-4d26-b31e-0b5e18fdeb1e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:24.893566 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-eadc6607-3d66-4d26-b31e-0b5e18fdeb1e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:24.894008 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-eadc6607-3d66-4d26-b31e-0b5e18fdeb1e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:24.932408 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-77035183-9106-427d-a11a-6f35eb77a0c5 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:24.940194 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-77035183-9106-427d-a11a-6f35eb77a0c5 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a" status: 200 len: 1521 microversion: 2.1 time: 0.174642 Dec 15 13:33:24.940761 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 194/382] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:24 2021] GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:33:24.945084 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-3a5358ca-078f-43f1-bbd0-9c2ce321ef78 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "de001934-ba67-451a-a11e-7a3771cd0947"}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:24.946182 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-3a5358ca-078f-43f1-bbd0-9c2ce321ef78 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 20c19dcc-7224-44dc-8921-a03017d002d7] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:24.951806 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3a5358ca-078f-43f1-bbd0-9c2ce321ef78 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:24.952270 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3a5358ca-078f-43f1-bbd0-9c2ce321ef78 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:24.953712 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3a5358ca-078f-43f1-bbd0-9c2ce321ef78 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:24.954166 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3a5358ca-078f-43f1-bbd0-9c2ce321ef78 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:24.975712 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-eadc6607-3d66-4d26-b31e-0b5e18fdeb1e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 28660 microversion: 2.1 time: 0.094134 Dec 15 13:33:24.976580 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 189/383] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:33:24 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 28660 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:33:24.981227 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-2397e6a8-dc3d-434e-b983-f3bb6733f6b7 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:24.985245 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:33:24.985245 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: warnings.warn(msg) Dec 15 13:33:24.986249 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-2397e6a8-dc3d-434e-b983-f3bb6733f6b7 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5ed1331bcb0e4fe4a53379d1d72f650a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38faa56e5864d3aba51e1e8351e3a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:24.987018 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-2397e6a8-dc3d-434e-b983-f3bb6733f6b7 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Searching by: {'deleted': False, 'project_id': 'c38faa56e5864d3aba51e1e8351e3a93'} {{(pid=116941) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 15 13:33:24.994399 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2397e6a8-dc3d-434e-b983-f3bb6733f6b7 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:24.994864 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2397e6a8-dc3d-434e-b983-f3bb6733f6b7 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:24.995686 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2397e6a8-dc3d-434e-b983-f3bb6733f6b7 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:24.996123 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2397e6a8-dc3d-434e-b983-f3bb6733f6b7 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:25.086095 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.multi_cell_list [None req-2397e6a8-dc3d-434e-b983-f3bb6733f6b7 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116941) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 15 13:33:25.183740 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-2397e6a8-dc3d-434e-b983-f3bb6733f6b7 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.205980 Dec 15 13:33:25.184257 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 190/384] 10.222.0.60 () {58 vars in 1124 bytes} [Wed Dec 15 13:33:24 2021] GET /compute/v2.1/servers => generated 342 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:33:25.189328 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-cbb15686-c193-4053-8a46-6ee71b022dc5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:25.190428 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-cbb15686-c193-4053-8a46-6ee71b022dc5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:25.196742 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cbb15686-c193-4053-8a46-6ee71b022dc5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:25.197264 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cbb15686-c193-4053-8a46-6ee71b022dc5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:25.198357 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cbb15686-c193-4053-8a46-6ee71b022dc5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:25.198800 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cbb15686-c193-4053-8a46-6ee71b022dc5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:25.209990 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-3a5358ca-078f-43f1-bbd0-9c2ce321ef78 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "POST /compute/v2.1/servers/20c19dcc-7224-44dc-8921-a03017d002d7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.268028 Dec 15 13:33:25.210840 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 195/385] 10.222.0.60 () {60 vars in 1322 bytes} [Wed Dec 15 13:33:24 2021] POST /compute/v2.1/servers/20c19dcc-7224-44dc-8921-a03017d002d7/os-volume_attachments => generated 194 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:33:25.216333 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-7a14beaa-b927-47c5-af03-808c2e2387de tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:25.217222 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-7a14beaa-b927-47c5-af03-808c2e2387de tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:25.225896 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7a14beaa-b927-47c5-af03-808c2e2387de tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:25.226359 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7a14beaa-b927-47c5-af03-808c2e2387de tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:25.227417 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7a14beaa-b927-47c5-af03-808c2e2387de tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:25.227865 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7a14beaa-b927-47c5-af03-808c2e2387de tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:25.274727 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-cbb15686-c193-4053-8a46-6ee71b022dc5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 28625 microversion: 2.20 time: 0.089170 Dec 15 13:33:25.275532 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 191/386] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:33:25 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 28625 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:33:25.375618 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-7a14beaa-b927-47c5-af03-808c2e2387de tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed1331bcb0e4fe4a53379d1d72f650a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38faa56e5864d3aba51e1e8351e3a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:25.383173 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-7a14beaa-b927-47c5-af03-808c2e2387de tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb" status: 200 len: 1547 microversion: 2.1 time: 0.171102 Dec 15 13:33:25.383820 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 196/387] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:25 2021] GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb => generated 1547 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:33:25.958288 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-bc6b2947-f003-430e-ae96-84d915b5bb8b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:25.959003 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-bc6b2947-f003-430e-ae96-84d915b5bb8b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:25.965714 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bc6b2947-f003-430e-ae96-84d915b5bb8b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:25.966172 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bc6b2947-f003-430e-ae96-84d915b5bb8b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:25.966988 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bc6b2947-f003-430e-ae96-84d915b5bb8b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:25.967434 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bc6b2947-f003-430e-ae96-84d915b5bb8b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:25.987611 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-526ff722-be7b-4473-af9f-803295f35e32 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:25.988580 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-526ff722-be7b-4473-af9f-803295f35e32 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:25.994746 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-526ff722-be7b-4473-af9f-803295f35e32 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:25.995235 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-526ff722-be7b-4473-af9f-803295f35e32 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:25.996022 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-526ff722-be7b-4473-af9f-803295f35e32 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:25.996468 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-526ff722-be7b-4473-af9f-803295f35e32 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:26.062434 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-526ff722-be7b-4473-af9f-803295f35e32 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 28660 microversion: 2.1 time: 0.078734 Dec 15 13:33:26.066699 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 197/388] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:33:25 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 28660 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:33:26.096942 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-bc6b2947-f003-430e-ae96-84d915b5bb8b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:26.104527 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-bc6b2947-f003-430e-ae96-84d915b5bb8b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a" status: 200 len: 1521 microversion: 2.1 time: 0.150463 Dec 15 13:33:26.105092 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 192/389] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:25 2021] GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:33:26.285898 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-e438a381-0477-48e8-8951-1ddd396b425e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:26.286953 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-e438a381-0477-48e8-8951-1ddd396b425e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:26.293672 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e438a381-0477-48e8-8951-1ddd396b425e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:26.294122 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e438a381-0477-48e8-8951-1ddd396b425e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:26.294937 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e438a381-0477-48e8-8951-1ddd396b425e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:26.295376 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e438a381-0477-48e8-8951-1ddd396b425e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:26.369806 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-e438a381-0477-48e8-8951-1ddd396b425e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 28625 microversion: 2.20 time: 0.087766 Dec 15 13:33:26.370658 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 198/390] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:33:26 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 28625 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:33:26.884501 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-a6981586-67da-4315-b4d9-877e7dac1198 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8a8040c5-544f-452c-ab69-8e1f5d846e40"}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:26.885499 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-a6981586-67da-4315-b4d9-877e7dac1198 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:26.892163 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a6981586-67da-4315-b4d9-877e7dac1198 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:26.892610 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a6981586-67da-4315-b4d9-877e7dac1198 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:26.893390 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a6981586-67da-4315-b4d9-877e7dac1198 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:26.893839 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a6981586-67da-4315-b4d9-877e7dac1198 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:27.076493 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-d422199d-a677-4971-aa39-51e0c9bf084e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:27.077470 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-d422199d-a677-4971-aa39-51e0c9bf084e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:27.086538 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d422199d-a677-4971-aa39-51e0c9bf084e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:27.087278 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d422199d-a677-4971-aa39-51e0c9bf084e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:27.088231 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d422199d-a677-4971-aa39-51e0c9bf084e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:27.088993 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d422199d-a677-4971-aa39-51e0c9bf084e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:27.160760 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-a6981586-67da-4315-b4d9-877e7dac1198 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "POST /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279798 Dec 15 13:33:27.161338 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 193/391] 10.222.0.60 () {60 vars in 1322 bytes} [Wed Dec 15 13:33:26 2021] POST /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:33:27.166086 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-bd41fc41-496d-4fbe-b04e-bec5625b4db9 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:27.166776 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-bd41fc41-496d-4fbe-b04e-bec5625b4db9 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:27.173457 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bd41fc41-496d-4fbe-b04e-bec5625b4db9 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:27.174136 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bd41fc41-496d-4fbe-b04e-bec5625b4db9 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:27.175146 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bd41fc41-496d-4fbe-b04e-bec5625b4db9 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:27.175580 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bd41fc41-496d-4fbe-b04e-bec5625b4db9 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:27.176704 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-d422199d-a677-4971-aa39-51e0c9bf084e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 28660 microversion: 2.1 time: 0.105857 Dec 15 13:33:27.177360 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 199/392] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:33:27 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 28660 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:33:27.316787 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-bd41fc41-496d-4fbe-b04e-bec5625b4db9 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:27.324429 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-bd41fc41-496d-4fbe-b04e-bec5625b4db9 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a" status: 200 len: 1521 microversion: 2.1 time: 0.161993 Dec 15 13:33:27.325013 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 194/393] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:27 2021] GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:33:27.381760 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-9c47fb0a-f63f-4d5d-848f-cb12a9c10828 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:27.382767 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-9c47fb0a-f63f-4d5d-848f-cb12a9c10828 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:27.389495 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9c47fb0a-f63f-4d5d-848f-cb12a9c10828 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:27.389946 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9c47fb0a-f63f-4d5d-848f-cb12a9c10828 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:27.391275 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9c47fb0a-f63f-4d5d-848f-cb12a9c10828 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:27.391764 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9c47fb0a-f63f-4d5d-848f-cb12a9c10828 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:27.470175 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-9c47fb0a-f63f-4d5d-848f-cb12a9c10828 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 28625 microversion: 2.20 time: 0.092333 Dec 15 13:33:27.470795 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 200/394] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:33:27 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 28625 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:33:28.189349 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-c52cbbf5-8813-4e31-897b-a533e8e2e18c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:28.190317 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-c52cbbf5-8813-4e31-897b-a533e8e2e18c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:28.196513 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c52cbbf5-8813-4e31-897b-a533e8e2e18c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:28.196963 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c52cbbf5-8813-4e31-897b-a533e8e2e18c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:28.197995 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c52cbbf5-8813-4e31-897b-a533e8e2e18c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:28.198436 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c52cbbf5-8813-4e31-897b-a533e8e2e18c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:28.268907 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-c52cbbf5-8813-4e31-897b-a533e8e2e18c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 28660 microversion: 2.1 time: 0.083592 Dec 15 13:33:28.272467 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 195/395] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:33:28 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 28660 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:33:28.341741 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-d9fb50c2-5899-4d47-b4f7-4b5b783ab12b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:28.342511 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-d9fb50c2-5899-4d47-b4f7-4b5b783ab12b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:28.349803 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d9fb50c2-5899-4d47-b4f7-4b5b783ab12b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:28.350261 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d9fb50c2-5899-4d47-b4f7-4b5b783ab12b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:28.351083 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d9fb50c2-5899-4d47-b4f7-4b5b783ab12b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:28.351526 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d9fb50c2-5899-4d47-b4f7-4b5b783ab12b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:28.482910 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-7ecb8828-5d73-480b-bfa7-8b498e799a15 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:28.483903 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-7ecb8828-5d73-480b-bfa7-8b498e799a15 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:28.491422 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7ecb8828-5d73-480b-bfa7-8b498e799a15 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:28.491873 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7ecb8828-5d73-480b-bfa7-8b498e799a15 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:28.492654 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7ecb8828-5d73-480b-bfa7-8b498e799a15 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:28.493259 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7ecb8828-5d73-480b-bfa7-8b498e799a15 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:28.500282 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-d9fb50c2-5899-4d47-b4f7-4b5b783ab12b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:28.509253 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-d9fb50c2-5899-4d47-b4f7-4b5b783ab12b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a" status: 200 len: 1521 microversion: 2.1 time: 0.171513 Dec 15 13:33:28.510971 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 201/396] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:28 2021] GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:33:28.564777 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-7ecb8828-5d73-480b-bfa7-8b498e799a15 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 28625 microversion: 2.20 time: 0.086637 Dec 15 13:33:28.568685 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 196/397] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:33:28 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 28625 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:33:29.280513 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-9b7067b3-de13-4533-a218-a90661fdd6e1 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:29.281286 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-9b7067b3-de13-4533-a218-a90661fdd6e1 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:29.287700 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9b7067b3-de13-4533-a218-a90661fdd6e1 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:29.288160 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9b7067b3-de13-4533-a218-a90661fdd6e1 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:29.288950 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9b7067b3-de13-4533-a218-a90661fdd6e1 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:29.289390 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9b7067b3-de13-4533-a218-a90661fdd6e1 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:29.376898 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-9b7067b3-de13-4533-a218-a90661fdd6e1 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 28660 microversion: 2.1 time: 0.100187 Dec 15 13:33:29.377588 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 202/398] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:33:29 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 28660 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:33:29.527157 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-0bf2638f-1025-4e74-a774-0cd4ccfa4c99 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:29.527909 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-0bf2638f-1025-4e74-a774-0cd4ccfa4c99 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:29.534651 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0bf2638f-1025-4e74-a774-0cd4ccfa4c99 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:29.535138 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0bf2638f-1025-4e74-a774-0cd4ccfa4c99 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:29.535916 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0bf2638f-1025-4e74-a774-0cd4ccfa4c99 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:29.536383 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0bf2638f-1025-4e74-a774-0cd4ccfa4c99 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:29.577062 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-7372b9cd-30c0-4c57-bcc6-e4179d77dfd1 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:29.578073 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-7372b9cd-30c0-4c57-bcc6-e4179d77dfd1 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:29.584903 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7372b9cd-30c0-4c57-bcc6-e4179d77dfd1 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:29.585368 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7372b9cd-30c0-4c57-bcc6-e4179d77dfd1 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:29.586162 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7372b9cd-30c0-4c57-bcc6-e4179d77dfd1 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:29.586605 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7372b9cd-30c0-4c57-bcc6-e4179d77dfd1 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:29.656783 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-7372b9cd-30c0-4c57-bcc6-e4179d77dfd1 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 28625 microversion: 2.20 time: 0.083815 Dec 15 13:33:29.658153 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 203/399] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:33:29 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 28625 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:33:29.670552 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-0bf2638f-1025-4e74-a774-0cd4ccfa4c99 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:29.678532 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-0bf2638f-1025-4e74-a774-0cd4ccfa4c99 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a" status: 200 len: 1521 microversion: 2.1 time: 0.155341 Dec 15 13:33:29.679296 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 197/400] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:29 2021] GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:33:30.388607 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-312f8c1a-45e9-433a-a44f-a2fad86158ea tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:30.389598 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-312f8c1a-45e9-433a-a44f-a2fad86158ea tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:30.396777 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-312f8c1a-45e9-433a-a44f-a2fad86158ea tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:30.397225 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-312f8c1a-45e9-433a-a44f-a2fad86158ea tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:30.398004 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-312f8c1a-45e9-433a-a44f-a2fad86158ea tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:30.398437 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-312f8c1a-45e9-433a-a44f-a2fad86158ea tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:30.470652 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-312f8c1a-45e9-433a-a44f-a2fad86158ea tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 28660 microversion: 2.1 time: 0.085784 Dec 15 13:33:30.472752 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 204/401] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:33:30 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 28660 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:33:30.668707 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-9d27cae1-99f2-40d2-b03b-f23fc84dc45c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:30.669669 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-9d27cae1-99f2-40d2-b03b-f23fc84dc45c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:30.676576 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9d27cae1-99f2-40d2-b03b-f23fc84dc45c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:30.677028 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9d27cae1-99f2-40d2-b03b-f23fc84dc45c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:30.677812 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9d27cae1-99f2-40d2-b03b-f23fc84dc45c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:30.678252 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9d27cae1-99f2-40d2-b03b-f23fc84dc45c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:30.696841 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-4b265847-c157-45ca-8fdf-bd713a6f2197 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:30.697874 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-4b265847-c157-45ca-8fdf-bd713a6f2197 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:30.704734 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4b265847-c157-45ca-8fdf-bd713a6f2197 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:30.705186 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4b265847-c157-45ca-8fdf-bd713a6f2197 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:30.705978 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4b265847-c157-45ca-8fdf-bd713a6f2197 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:30.706418 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4b265847-c157-45ca-8fdf-bd713a6f2197 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:30.741884 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-9d27cae1-99f2-40d2-b03b-f23fc84dc45c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 28625 microversion: 2.20 time: 0.076808 Dec 15 13:33:30.743615 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 198/402] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:33:30 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 28625 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:33:30.844114 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-4b265847-c157-45ca-8fdf-bd713a6f2197 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:30.851449 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-4b265847-c157-45ca-8fdf-bd713a6f2197 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a" status: 200 len: 1521 microversion: 2.1 time: 0.158765 Dec 15 13:33:30.852017 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 205/403] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:30 2021] GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:33:31.485017 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-b4d39275-9fee-4916-b9ec-34bbfa213f5f tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:31.486067 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-b4d39275-9fee-4916-b9ec-34bbfa213f5f tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:31.493244 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b4d39275-9fee-4916-b9ec-34bbfa213f5f tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:31.493696 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b4d39275-9fee-4916-b9ec-34bbfa213f5f tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:31.494492 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b4d39275-9fee-4916-b9ec-34bbfa213f5f tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:31.495075 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b4d39275-9fee-4916-b9ec-34bbfa213f5f tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:31.571173 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-b4d39275-9fee-4916-b9ec-34bbfa213f5f tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 28660 microversion: 2.1 time: 0.091138 Dec 15 13:33:31.571855 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 199/404] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:33:31 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 28660 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:33:31.790282 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-31090518-9720-4380-bdf4-dd0ac493ee51 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:31.791215 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-31090518-9720-4380-bdf4-dd0ac493ee51 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:31.797499 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-31090518-9720-4380-bdf4-dd0ac493ee51 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:31.797949 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-31090518-9720-4380-bdf4-dd0ac493ee51 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:31.798721 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-31090518-9720-4380-bdf4-dd0ac493ee51 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:31.799179 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-31090518-9720-4380-bdf4-dd0ac493ee51 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:31.869141 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-98482635-5043-4df3-937d-9eda27147228 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:31.869833 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-98482635-5043-4df3-937d-9eda27147228 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:31.876636 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-98482635-5043-4df3-937d-9eda27147228 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:31.877083 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-98482635-5043-4df3-937d-9eda27147228 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:31.877848 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-98482635-5043-4df3-937d-9eda27147228 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:31.878280 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-98482635-5043-4df3-937d-9eda27147228 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:31.884314 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-31090518-9720-4380-bdf4-dd0ac493ee51 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 28625 microversion: 2.20 time: 0.097513 Dec 15 13:33:31.885241 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 206/405] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:33:31 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 28625 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:33:32.013185 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-98482635-5043-4df3-937d-9eda27147228 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:32.021306 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-98482635-5043-4df3-937d-9eda27147228 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a" status: 200 len: 1521 microversion: 2.1 time: 0.156125 Dec 15 13:33:32.022132 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 200/406] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:31 2021] GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:33:32.583368 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-7162f3cd-dee9-48ce-a686-83183d748939 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:32.584364 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-7162f3cd-dee9-48ce-a686-83183d748939 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:32.591362 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7162f3cd-dee9-48ce-a686-83183d748939 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:32.591808 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7162f3cd-dee9-48ce-a686-83183d748939 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:32.592588 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7162f3cd-dee9-48ce-a686-83183d748939 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:32.593025 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7162f3cd-dee9-48ce-a686-83183d748939 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:32.673280 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-7162f3cd-dee9-48ce-a686-83183d748939 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 28660 microversion: 2.1 time: 0.093850 Dec 15 13:33:32.676992 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 207/407] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:33:32 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 28660 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:33:32.692355 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-4ff97db4-3188-48a6-b35c-cb07a94d5b2c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "de001934-ba67-451a-a11e-7a3771cd0947"}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:32.693421 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-4ff97db4-3188-48a6-b35c-cb07a94d5b2c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 20c19dcc-7224-44dc-8921-a03017d002d7] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:32.699994 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4ff97db4-3188-48a6-b35c-cb07a94d5b2c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:32.700448 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4ff97db4-3188-48a6-b35c-cb07a94d5b2c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:32.701232 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4ff97db4-3188-48a6-b35c-cb07a94d5b2c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:32.701674 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4ff97db4-3188-48a6-b35c-cb07a94d5b2c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:32.777116 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.wsgi [None req-4ff97db4-3188-48a6-b35c-cb07a94d5b2c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] HTTP exception thrown: Invalid volume: volume de001934-ba67-451a-a11e-7a3771cd0947 is already attached to instances: 20c19dcc-7224-44dc-8921-a03017d002d7 Dec 15 13:33:32.777729 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-4ff97db4-3188-48a6-b35c-cb07a94d5b2c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Returning 400 to user: Invalid volume: volume de001934-ba67-451a-a11e-7a3771cd0947 is already attached to instances: 20c19dcc-7224-44dc-8921-a03017d002d7 {{(pid=116941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:33:32.778582 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-4ff97db4-3188-48a6-b35c-cb07a94d5b2c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "POST /compute/v2.1/servers/20c19dcc-7224-44dc-8921-a03017d002d7/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.090055 Dec 15 13:33:32.779176 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 201/408] 10.222.0.60 () {60 vars in 1322 bytes} [Wed Dec 15 13:33:32 2021] POST /compute/v2.1/servers/20c19dcc-7224-44dc-8921-a03017d002d7/os-volume_attachments => generated 174 bytes in 92 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Dec 15 13:33:32.836298 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-e5484eef-2068-4c32-b477-29185069ec33 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:32.836877 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-e5484eef-2068-4c32-b477-29185069ec33 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 20c19dcc-7224-44dc-8921-a03017d002d7] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:32.843701 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e5484eef-2068-4c32-b477-29185069ec33 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:32.844149 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e5484eef-2068-4c32-b477-29185069ec33 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:32.844920 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e5484eef-2068-4c32-b477-29185069ec33 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:32.845358 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e5484eef-2068-4c32-b477-29185069ec33 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:32.895751 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-3984ab29-85e9-40ec-aba9-c14490d24810 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:32.896848 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-3984ab29-85e9-40ec-aba9-c14490d24810 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:32.902704 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3984ab29-85e9-40ec-aba9-c14490d24810 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:32.903210 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3984ab29-85e9-40ec-aba9-c14490d24810 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:32.903998 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3984ab29-85e9-40ec-aba9-c14490d24810 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:32.904439 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3984ab29-85e9-40ec-aba9-c14490d24810 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:32.962539 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.objects.instance [None req-e5484eef-2068-4c32-b477-29185069ec33 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lazy-loading 'services' on Instance uuid 20c19dcc-7224-44dc-8921-a03017d002d7 {{(pid=116942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:33:33.039717 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-3984ab29-85e9-40ec-aba9-c14490d24810 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 28625 microversion: 2.20 time: 0.147464 Dec 15 13:33:33.040611 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 202/409] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:33:32 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 28625 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:33:33.045104 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-4d161a44-e78b-47dd-ae8c-a6b40a7cce97 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:33.045903 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-4d161a44-e78b-47dd-ae8c-a6b40a7cce97 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:33.053158 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4d161a44-e78b-47dd-ae8c-a6b40a7cce97 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:33.053606 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4d161a44-e78b-47dd-ae8c-a6b40a7cce97 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:33.054394 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4d161a44-e78b-47dd-ae8c-a6b40a7cce97 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:33.055066 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4d161a44-e78b-47dd-ae8c-a6b40a7cce97 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:33.073232 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-e5484eef-2068-4c32-b477-29185069ec33 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "DELETE /compute/v2.1/servers/20c19dcc-7224-44dc-8921-a03017d002d7/os-volume_attachments/de001934-ba67-451a-a11e-7a3771cd0947" status: 202 len: 0 microversion: 2.1 time: 0.240808 Dec 15 13:33:33.073920 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 208/410] 10.222.0.60 () {58 vars in 1415 bytes} [Wed Dec 15 13:33:32 2021] DELETE /compute/v2.1/servers/20c19dcc-7224-44dc-8921-a03017d002d7/os-volume_attachments/de001934-ba67-451a-a11e-7a3771cd0947 => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:33:33.083131 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-23025956-3c2f-4477-bdfd-c44b09f06033 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:33.084285 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-23025956-3c2f-4477-bdfd-c44b09f06033 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 20c19dcc-7224-44dc-8921-a03017d002d7] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:33.090688 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-23025956-3c2f-4477-bdfd-c44b09f06033 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:33.091257 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-23025956-3c2f-4477-bdfd-c44b09f06033 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:33.092129 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-23025956-3c2f-4477-bdfd-c44b09f06033 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:33.092639 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-23025956-3c2f-4477-bdfd-c44b09f06033 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:33.124983 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-23025956-3c2f-4477-bdfd-c44b09f06033 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/20c19dcc-7224-44dc-8921-a03017d002d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046059 Dec 15 13:33:33.125754 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 209/411] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Dec 15 13:33:33 2021] GET /compute/v2.1/servers/20c19dcc-7224-44dc-8921-a03017d002d7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:33:33.196092 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-4d161a44-e78b-47dd-ae8c-a6b40a7cce97 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:33.203543 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-4d161a44-e78b-47dd-ae8c-a6b40a7cce97 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a" status: 200 len: 1521 microversion: 2.1 time: 0.162096 Dec 15 13:33:33.204150 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 203/412] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:33 2021] GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:33:33.684725 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-93b075f1-330f-42bc-8a5a-0b818535c3d1 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:33.685825 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-93b075f1-330f-42bc-8a5a-0b818535c3d1 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:33.692975 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-93b075f1-330f-42bc-8a5a-0b818535c3d1 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:33.694246 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-93b075f1-330f-42bc-8a5a-0b818535c3d1 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:33.695257 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-93b075f1-330f-42bc-8a5a-0b818535c3d1 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:33.695782 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-93b075f1-330f-42bc-8a5a-0b818535c3d1 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:33.794291 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-93b075f1-330f-42bc-8a5a-0b818535c3d1 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 28660 microversion: 2.1 time: 0.112897 Dec 15 13:33:33.795667 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 210/413] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:33:33 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 28660 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:33:34.052380 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-ca79f923-86d4-4431-92bb-48c6a27fa505 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:34.053470 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-ca79f923-86d4-4431-92bb-48c6a27fa505 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:34.059743 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ca79f923-86d4-4431-92bb-48c6a27fa505 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:34.060286 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ca79f923-86d4-4431-92bb-48c6a27fa505 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:34.061157 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ca79f923-86d4-4431-92bb-48c6a27fa505 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:34.061713 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ca79f923-86d4-4431-92bb-48c6a27fa505 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:34.137115 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-eeb602ec-dbe6-472c-bfc3-d4a6c0c5e5ef tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:34.138132 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-eeb602ec-dbe6-472c-bfc3-d4a6c0c5e5ef tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 20c19dcc-7224-44dc-8921-a03017d002d7] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:34.145105 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-eeb602ec-dbe6-472c-bfc3-d4a6c0c5e5ef tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:34.145574 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-eeb602ec-dbe6-472c-bfc3-d4a6c0c5e5ef tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:34.146359 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-eeb602ec-dbe6-472c-bfc3-d4a6c0c5e5ef tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:34.146799 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-eeb602ec-dbe6-472c-bfc3-d4a6c0c5e5ef tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:34.175687 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-eeb602ec-dbe6-472c-bfc3-d4a6c0c5e5ef tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/20c19dcc-7224-44dc-8921-a03017d002d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042742 Dec 15 13:33:34.176257 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 211/414] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Dec 15 13:33:34 2021] GET /compute/v2.1/servers/20c19dcc-7224-44dc-8921-a03017d002d7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:33:34.219947 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-ca79f923-86d4-4431-92bb-48c6a27fa505 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 28625 microversion: 2.20 time: 0.171410 Dec 15 13:33:34.220105 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-71f9912d-a23f-4015-b4ed-b2fff3440514 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:34.220675 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-71f9912d-a23f-4015-b4ed-b2fff3440514 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:34.220809 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 204/415] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:33:34 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 28625 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:33:34.226840 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-71f9912d-a23f-4015-b4ed-b2fff3440514 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:34.227326 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-71f9912d-a23f-4015-b4ed-b2fff3440514 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:34.228113 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-71f9912d-a23f-4015-b4ed-b2fff3440514 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:34.228553 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-71f9912d-a23f-4015-b4ed-b2fff3440514 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:34.355260 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-71f9912d-a23f-4015-b4ed-b2fff3440514 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:34.362811 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-71f9912d-a23f-4015-b4ed-b2fff3440514 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a" status: 200 len: 1521 microversion: 2.1 time: 0.146232 Dec 15 13:33:34.363404 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 212/416] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:34 2021] GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:33:34.807220 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-3f89b65c-3080-4c4d-a929-abe91e31998b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:34.808220 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-3f89b65c-3080-4c4d-a929-abe91e31998b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:34.815009 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3f89b65c-3080-4c4d-a929-abe91e31998b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:34.815461 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3f89b65c-3080-4c4d-a929-abe91e31998b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:34.816231 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3f89b65c-3080-4c4d-a929-abe91e31998b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:34.816661 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3f89b65c-3080-4c4d-a929-abe91e31998b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:34.884335 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-3f89b65c-3080-4c4d-a929-abe91e31998b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 28660 microversion: 2.1 time: 0.081192 Dec 15 13:33:34.884875 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 205/417] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:33:34 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 28660 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:33:35.187492 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-3cdc4977-45ec-49c7-a263-49eb48e86fea tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:35.188364 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-3cdc4977-45ec-49c7-a263-49eb48e86fea tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 20c19dcc-7224-44dc-8921-a03017d002d7] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:35.194457 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3cdc4977-45ec-49c7-a263-49eb48e86fea tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:35.194935 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3cdc4977-45ec-49c7-a263-49eb48e86fea tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:35.195858 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3cdc4977-45ec-49c7-a263-49eb48e86fea tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:35.196299 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3cdc4977-45ec-49c7-a263-49eb48e86fea tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:35.225132 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-3cdc4977-45ec-49c7-a263-49eb48e86fea tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/20c19dcc-7224-44dc-8921-a03017d002d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042022 Dec 15 13:33:35.225681 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 213/418] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Dec 15 13:33:35 2021] GET /compute/v2.1/servers/20c19dcc-7224-44dc-8921-a03017d002d7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:33:35.232251 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-c6762804-f20a-4da4-85e2-f101d9bb73a1 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:35.233256 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-c6762804-f20a-4da4-85e2-f101d9bb73a1 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:35.240018 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c6762804-f20a-4da4-85e2-f101d9bb73a1 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:35.240467 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c6762804-f20a-4da4-85e2-f101d9bb73a1 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:35.241427 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c6762804-f20a-4da4-85e2-f101d9bb73a1 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:35.241959 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c6762804-f20a-4da4-85e2-f101d9bb73a1 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:35.345424 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-c6762804-f20a-4da4-85e2-f101d9bb73a1 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 28625 microversion: 2.20 time: 0.117041 Dec 15 13:33:35.346361 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 206/419] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:33:35 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 28625 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:33:35.380373 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-128428fc-bc57-4bc7-9bff-ecff37350b37 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:35.380995 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-128428fc-bc57-4bc7-9bff-ecff37350b37 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:35.386806 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-128428fc-bc57-4bc7-9bff-ecff37350b37 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:35.387285 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-128428fc-bc57-4bc7-9bff-ecff37350b37 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:35.388057 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-128428fc-bc57-4bc7-9bff-ecff37350b37 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:35.388493 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-128428fc-bc57-4bc7-9bff-ecff37350b37 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:35.524480 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-128428fc-bc57-4bc7-9bff-ecff37350b37 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:35.531962 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-128428fc-bc57-4bc7-9bff-ecff37350b37 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a" status: 200 len: 1521 microversion: 2.1 time: 0.155833 Dec 15 13:33:35.532533 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 214/420] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:35 2021] GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:33:35.896397 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-a2c0a246-14e6-4b26-9b06-54204bd5c64e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:35.897320 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-a2c0a246-14e6-4b26-9b06-54204bd5c64e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:35.904100 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a2c0a246-14e6-4b26-9b06-54204bd5c64e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:35.904550 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a2c0a246-14e6-4b26-9b06-54204bd5c64e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:35.905822 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a2c0a246-14e6-4b26-9b06-54204bd5c64e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:35.906261 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a2c0a246-14e6-4b26-9b06-54204bd5c64e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:35.973330 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-a2c0a246-14e6-4b26-9b06-54204bd5c64e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 28660 microversion: 2.1 time: 0.081083 Dec 15 13:33:35.973985 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 207/421] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:33:35 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 28660 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:33:36.236960 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-13253f08-fb22-48f0-b6e4-3d51d56e89a4 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:36.237998 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-13253f08-fb22-48f0-b6e4-3d51d56e89a4 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 20c19dcc-7224-44dc-8921-a03017d002d7] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:36.244174 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-13253f08-fb22-48f0-b6e4-3d51d56e89a4 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:36.244647 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-13253f08-fb22-48f0-b6e4-3d51d56e89a4 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:36.245443 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-13253f08-fb22-48f0-b6e4-3d51d56e89a4 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:36.245823 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-13253f08-fb22-48f0-b6e4-3d51d56e89a4 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:36.275106 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-13253f08-fb22-48f0-b6e4-3d51d56e89a4 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/20c19dcc-7224-44dc-8921-a03017d002d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042494 Dec 15 13:33:36.275739 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 215/422] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Dec 15 13:33:36 2021] GET /compute/v2.1/servers/20c19dcc-7224-44dc-8921-a03017d002d7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:33:36.357397 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-66ef9fbb-dbc8-47ec-b5fc-f23607df7b41 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:36.358401 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-66ef9fbb-dbc8-47ec-b5fc-f23607df7b41 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:36.365841 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-66ef9fbb-dbc8-47ec-b5fc-f23607df7b41 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:36.366363 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-66ef9fbb-dbc8-47ec-b5fc-f23607df7b41 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:36.367177 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-66ef9fbb-dbc8-47ec-b5fc-f23607df7b41 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:36.367612 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-66ef9fbb-dbc8-47ec-b5fc-f23607df7b41 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:36.429936 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-66ef9fbb-dbc8-47ec-b5fc-f23607df7b41 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 28625 microversion: 2.20 time: 0.076785 Dec 15 13:33:36.430538 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 208/423] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:33:36 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 28625 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:33:36.548708 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-dad0a5b5-3e97-4657-b7e0-c0f1adbe7286 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:36.549315 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-dad0a5b5-3e97-4657-b7e0-c0f1adbe7286 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:36.555190 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-dad0a5b5-3e97-4657-b7e0-c0f1adbe7286 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:36.555641 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-dad0a5b5-3e97-4657-b7e0-c0f1adbe7286 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:36.556421 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-dad0a5b5-3e97-4657-b7e0-c0f1adbe7286 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:36.556855 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-dad0a5b5-3e97-4657-b7e0-c0f1adbe7286 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:36.693543 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-dad0a5b5-3e97-4657-b7e0-c0f1adbe7286 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:36.701400 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-dad0a5b5-3e97-4657-b7e0-c0f1adbe7286 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a" status: 200 len: 1501 microversion: 2.1 time: 0.156336 Dec 15 13:33:36.702068 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 216/424] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:36 2021] GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a => generated 1501 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:33:36.718488 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-52d7a087-d983-4414-8e6e-a3d180dbe793 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cf978993-2236-43ca-9db2-8a2af353e607"}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:36.719663 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-52d7a087-d983-4414-8e6e-a3d180dbe793 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:36.726341 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-52d7a087-d983-4414-8e6e-a3d180dbe793 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:36.726791 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-52d7a087-d983-4414-8e6e-a3d180dbe793 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:36.727596 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-52d7a087-d983-4414-8e6e-a3d180dbe793 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:36.728033 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-52d7a087-d983-4414-8e6e-a3d180dbe793 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:36.750753 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.wsgi [None req-52d7a087-d983-4414-8e6e-a3d180dbe793 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] HTTP exception thrown: Cannot 'attach_volume' instance eab2a5ce-9a56-4120-ae3c-ddfb844aa30a while it is in vm_state rescued Dec 15 13:33:36.751401 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-52d7a087-d983-4414-8e6e-a3d180dbe793 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Returning 409 to user: Cannot 'attach_volume' instance eab2a5ce-9a56-4120-ae3c-ddfb844aa30a while it is in vm_state rescued {{(pid=116941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:33:36.752219 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-52d7a087-d983-4414-8e6e-a3d180dbe793 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "POST /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.037884 Dec 15 13:33:36.752759 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 209/425] 10.222.0.60 () {60 vars in 1322 bytes} [Wed Dec 15 13:33:36 2021] POST /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a/os-volume_attachments => generated 152 bytes in 39 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 15 13:33:36.761158 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-995b63e4-ce0d-4c34-9d36-5ece795bf83b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:36.761687 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-995b63e4-ce0d-4c34-9d36-5ece795bf83b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:36.768129 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-995b63e4-ce0d-4c34-9d36-5ece795bf83b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:36.768576 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-995b63e4-ce0d-4c34-9d36-5ece795bf83b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:36.769349 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-995b63e4-ce0d-4c34-9d36-5ece795bf83b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:36.769784 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-995b63e4-ce0d-4c34-9d36-5ece795bf83b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:36.831116 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-995b63e4-ce0d-4c34-9d36-5ece795bf83b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "POST /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a/action" status: 202 len: 0 microversion: 2.1 time: 0.073498 Dec 15 13:33:36.831762 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 217/426] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:33:36 2021] POST /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:33:36.839497 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-5905bdaa-7f8f-4f34-802a-e44e193cc920 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:36.840109 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-5905bdaa-7f8f-4f34-802a-e44e193cc920 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:36.846425 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5905bdaa-7f8f-4f34-802a-e44e193cc920 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:36.846899 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5905bdaa-7f8f-4f34-802a-e44e193cc920 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:36.847689 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5905bdaa-7f8f-4f34-802a-e44e193cc920 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:36.848130 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5905bdaa-7f8f-4f34-802a-e44e193cc920 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:36.977431 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-5905bdaa-7f8f-4f34-802a-e44e193cc920 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:36.985227 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-5905bdaa-7f8f-4f34-802a-e44e193cc920 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a" status: 200 len: 1509 microversion: 2.1 time: 0.149236 Dec 15 13:33:36.985682 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 210/427] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:36 2021] GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a => generated 1509 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:33:37.019190 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-a7e2dddf-b1dc-43e6-8628-2b5e8f1d6622 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:37.020315 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-a7e2dddf-b1dc-43e6-8628-2b5e8f1d6622 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:37.026399 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a7e2dddf-b1dc-43e6-8628-2b5e8f1d6622 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:37.026859 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a7e2dddf-b1dc-43e6-8628-2b5e8f1d6622 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:37.027675 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a7e2dddf-b1dc-43e6-8628-2b5e8f1d6622 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:37.028115 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a7e2dddf-b1dc-43e6-8628-2b5e8f1d6622 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:37.104281 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-a7e2dddf-b1dc-43e6-8628-2b5e8f1d6622 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 28660 microversion: 2.1 time: 0.088914 Dec 15 13:33:37.104957 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 218/428] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:33:37 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 28660 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:33:37.286421 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-39b47a1d-c3e0-4b7b-87cb-cb14464c9e7d tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:37.287476 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-39b47a1d-c3e0-4b7b-87cb-cb14464c9e7d tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 20c19dcc-7224-44dc-8921-a03017d002d7] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:37.293693 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-39b47a1d-c3e0-4b7b-87cb-cb14464c9e7d tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:37.294139 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-39b47a1d-c3e0-4b7b-87cb-cb14464c9e7d tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:37.294941 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-39b47a1d-c3e0-4b7b-87cb-cb14464c9e7d tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:37.295379 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-39b47a1d-c3e0-4b7b-87cb-cb14464c9e7d tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:37.327079 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-39b47a1d-c3e0-4b7b-87cb-cb14464c9e7d tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/20c19dcc-7224-44dc-8921-a03017d002d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044317 Dec 15 13:33:37.327650 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 211/429] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Dec 15 13:33:37 2021] GET /compute/v2.1/servers/20c19dcc-7224-44dc-8921-a03017d002d7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:33:37.441477 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-f594ae00-f129-4cae-b5ba-51da561a32ed tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:37.442507 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-f594ae00-f129-4cae-b5ba-51da561a32ed tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:37.449478 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f594ae00-f129-4cae-b5ba-51da561a32ed tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:37.449924 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f594ae00-f129-4cae-b5ba-51da561a32ed tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:37.450709 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f594ae00-f129-4cae-b5ba-51da561a32ed tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:37.451171 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f594ae00-f129-4cae-b5ba-51da561a32ed tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:37.524967 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-f594ae00-f129-4cae-b5ba-51da561a32ed tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 28625 microversion: 2.20 time: 0.087319 Dec 15 13:33:37.528840 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 219/430] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:33:37 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 28625 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:33:38.001765 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-b9f75a65-b236-488a-9031-1d86fadaf628 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:38.002322 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-b9f75a65-b236-488a-9031-1d86fadaf628 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:38.009033 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b9f75a65-b236-488a-9031-1d86fadaf628 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:38.009496 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b9f75a65-b236-488a-9031-1d86fadaf628 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:38.010350 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b9f75a65-b236-488a-9031-1d86fadaf628 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:38.010794 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b9f75a65-b236-488a-9031-1d86fadaf628 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:38.118474 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-56f4613a-7f49-42ce-bd82-0d51dddbadcb tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:38.119553 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-56f4613a-7f49-42ce-bd82-0d51dddbadcb tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:38.127242 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-56f4613a-7f49-42ce-bd82-0d51dddbadcb tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:38.127708 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-56f4613a-7f49-42ce-bd82-0d51dddbadcb tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:38.128528 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-56f4613a-7f49-42ce-bd82-0d51dddbadcb tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:38.128986 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-56f4613a-7f49-42ce-bd82-0d51dddbadcb tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:38.152646 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-b9f75a65-b236-488a-9031-1d86fadaf628 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:38.160293 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-b9f75a65-b236-488a-9031-1d86fadaf628 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a" status: 200 len: 1509 microversion: 2.1 time: 0.162293 Dec 15 13:33:38.160927 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 212/431] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:37 2021] GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:33:38.213254 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-56f4613a-7f49-42ce-bd82-0d51dddbadcb tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 28660 microversion: 2.1 time: 0.099508 Dec 15 13:33:38.214030 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 220/432] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:33:38 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 28660 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:33:38.337381 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-3778607b-3337-4201-991c-7787f4027291 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:38.338328 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-3778607b-3337-4201-991c-7787f4027291 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 20c19dcc-7224-44dc-8921-a03017d002d7] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:38.344180 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3778607b-3337-4201-991c-7787f4027291 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:38.344636 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3778607b-3337-4201-991c-7787f4027291 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:38.345420 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3778607b-3337-4201-991c-7787f4027291 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:38.345862 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3778607b-3337-4201-991c-7787f4027291 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:38.374558 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-3778607b-3337-4201-991c-7787f4027291 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/20c19dcc-7224-44dc-8921-a03017d002d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040359 Dec 15 13:33:38.375182 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 213/433] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Dec 15 13:33:38 2021] GET /compute/v2.1/servers/20c19dcc-7224-44dc-8921-a03017d002d7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:33:38.537243 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-cc880527-326b-45c4-af32-302b59e41d1a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:38.538285 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-cc880527-326b-45c4-af32-302b59e41d1a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:38.545062 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-cc880527-326b-45c4-af32-302b59e41d1a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:38.545509 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-cc880527-326b-45c4-af32-302b59e41d1a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:38.546781 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-cc880527-326b-45c4-af32-302b59e41d1a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:38.547244 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-cc880527-326b-45c4-af32-302b59e41d1a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:38.619889 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-cc880527-326b-45c4-af32-302b59e41d1a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 28625 microversion: 2.20 time: 0.086519 Dec 15 13:33:38.620564 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 221/434] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:33:38 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 28625 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:33:39.178331 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-a6c5e294-4788-4c53-bc55-a78cc95dedda tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:39.178970 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-a6c5e294-4788-4c53-bc55-a78cc95dedda tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:39.185059 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a6c5e294-4788-4c53-bc55-a78cc95dedda tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:39.185507 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a6c5e294-4788-4c53-bc55-a78cc95dedda tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:39.186299 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a6c5e294-4788-4c53-bc55-a78cc95dedda tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:39.186711 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a6c5e294-4788-4c53-bc55-a78cc95dedda tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:39.225339 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-9e359ada-9e7a-4414-8449-d19939d0142a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:39.226358 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-9e359ada-9e7a-4414-8449-d19939d0142a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:39.233085 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9e359ada-9e7a-4414-8449-d19939d0142a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:39.234095 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9e359ada-9e7a-4414-8449-d19939d0142a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:39.234904 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9e359ada-9e7a-4414-8449-d19939d0142a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:39.235340 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9e359ada-9e7a-4414-8449-d19939d0142a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:39.310609 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-9e359ada-9e7a-4414-8449-d19939d0142a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 28660 microversion: 2.1 time: 0.088989 Dec 15 13:33:39.311361 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 222/435] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:33:39 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 28660 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:33:39.323566 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-a6c5e294-4788-4c53-bc55-a78cc95dedda tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:39.331413 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-a6c5e294-4788-4c53-bc55-a78cc95dedda tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a" status: 200 len: 1509 microversion: 2.1 time: 0.156662 Dec 15 13:33:39.332028 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 214/436] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:39 2021] GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:33:39.385863 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-113b15f5-6d8c-4612-b26f-7b5c6ef27f2a tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:39.386869 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-113b15f5-6d8c-4612-b26f-7b5c6ef27f2a tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 20c19dcc-7224-44dc-8921-a03017d002d7] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:39.394942 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-113b15f5-6d8c-4612-b26f-7b5c6ef27f2a tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:39.395391 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-113b15f5-6d8c-4612-b26f-7b5c6ef27f2a tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:39.396175 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-113b15f5-6d8c-4612-b26f-7b5c6ef27f2a tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:39.396679 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-113b15f5-6d8c-4612-b26f-7b5c6ef27f2a tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:39.427801 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-113b15f5-6d8c-4612-b26f-7b5c6ef27f2a tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/20c19dcc-7224-44dc-8921-a03017d002d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045952 Dec 15 13:33:39.428364 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 223/437] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Dec 15 13:33:39 2021] GET /compute/v2.1/servers/20c19dcc-7224-44dc-8921-a03017d002d7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:33:39.631250 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-1e259e99-4d03-49f4-87c2-1d356a9bd83e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:39.632163 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-1e259e99-4d03-49f4-87c2-1d356a9bd83e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:39.637962 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1e259e99-4d03-49f4-87c2-1d356a9bd83e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:39.638681 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1e259e99-4d03-49f4-87c2-1d356a9bd83e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:39.639269 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1e259e99-4d03-49f4-87c2-1d356a9bd83e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:39.640294 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1e259e99-4d03-49f4-87c2-1d356a9bd83e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:39.759256 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-1e259e99-4d03-49f4-87c2-1d356a9bd83e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 28625 microversion: 2.20 time: 0.131382 Dec 15 13:33:39.760238 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 215/438] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:33:39 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 28625 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:33:40.009335 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-b4ac8c83-189b-4755-a66c-0de6f6b299e2 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:40.009889 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-b4ac8c83-189b-4755-a66c-0de6f6b299e2 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:40.027656 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b4ac8c83-189b-4755-a66c-0de6f6b299e2 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:40.028141 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b4ac8c83-189b-4755-a66c-0de6f6b299e2 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:40.029005 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b4ac8c83-189b-4755-a66c-0de6f6b299e2 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:40.029454 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b4ac8c83-189b-4755-a66c-0de6f6b299e2 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:40.169844 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-b4ac8c83-189b-4755-a66c-0de6f6b299e2 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed1331bcb0e4fe4a53379d1d72f650a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38faa56e5864d3aba51e1e8351e3a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:40.178729 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-b4ac8c83-189b-4755-a66c-0de6f6b299e2 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb" status: 200 len: 1593 microversion: 2.1 time: 0.173381 Dec 15 13:33:40.179350 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 224/439] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:40 2021] GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb => generated 1593 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:33:40.322084 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-9483c9c3-9d36-4885-8d9a-8246ac043cac tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:40.323728 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-9483c9c3-9d36-4885-8d9a-8246ac043cac tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:40.330549 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9483c9c3-9d36-4885-8d9a-8246ac043cac tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:40.331050 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9483c9c3-9d36-4885-8d9a-8246ac043cac tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:40.331838 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9483c9c3-9d36-4885-8d9a-8246ac043cac tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:40.332278 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9483c9c3-9d36-4885-8d9a-8246ac043cac tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:40.348249 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-f3afdc42-648b-4c84-82ac-312394fd13b3 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:40.349134 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-f3afdc42-648b-4c84-82ac-312394fd13b3 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:40.356479 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f3afdc42-648b-4c84-82ac-312394fd13b3 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:40.357076 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f3afdc42-648b-4c84-82ac-312394fd13b3 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:40.358012 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f3afdc42-648b-4c84-82ac-312394fd13b3 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:40.359240 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f3afdc42-648b-4c84-82ac-312394fd13b3 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:40.404060 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-9483c9c3-9d36-4885-8d9a-8246ac043cac tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 28660 microversion: 2.1 time: 0.085795 Dec 15 13:33:40.404634 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 216/440] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:33:40 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 28660 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:33:40.440619 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-bda4c311-eaa3-4c8e-89b0-11a3a287b35b tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:40.442191 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-bda4c311-eaa3-4c8e-89b0-11a3a287b35b tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 20c19dcc-7224-44dc-8921-a03017d002d7] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:40.453532 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bda4c311-eaa3-4c8e-89b0-11a3a287b35b tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:40.454211 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bda4c311-eaa3-4c8e-89b0-11a3a287b35b tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:40.455209 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bda4c311-eaa3-4c8e-89b0-11a3a287b35b tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:40.455813 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bda4c311-eaa3-4c8e-89b0-11a3a287b35b tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:40.500066 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-bda4c311-eaa3-4c8e-89b0-11a3a287b35b tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/20c19dcc-7224-44dc-8921-a03017d002d7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063822 Dec 15 13:33:40.500759 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 217/441] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Dec 15 13:33:40 2021] GET /compute/v2.1/servers/20c19dcc-7224-44dc-8921-a03017d002d7/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 13:33:40.587287 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-f3afdc42-648b-4c84-82ac-312394fd13b3 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:40.598624 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-f3afdc42-648b-4c84-82ac-312394fd13b3 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a" status: 200 len: 1509 microversion: 2.1 time: 0.253914 Dec 15 13:33:40.600000 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 225/442] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:40 2021] GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a => generated 1509 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:33:40.666788 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-f45fe97d-14c7-4e96-84fd-d2787b502950 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1508555196", "imageRef": "cfccedbb-7169-47ec-9bae-d4829cba54e1", "flavorRef": "452", "networks": [{"uuid": "12997ed3-8144-436a-8d20-22135e6511e5"}]}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:40.734450 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.network.neutron [None req-f45fe97d-14c7-4e96-84fd-d2787b502950 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] validate_networks() for [('12997ed3-8144-436a-8d20-22135e6511e5', None, None, None, None, None)] {{(pid=116941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:33:40.772138 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-c8be10e7-2171-4c85-99f2-167b0d3d5ea9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:40.775159 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-c8be10e7-2171-4c85-99f2-167b0d3d5ea9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:40.785752 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c8be10e7-2171-4c85-99f2-167b0d3d5ea9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:40.786666 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c8be10e7-2171-4c85-99f2-167b0d3d5ea9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:40.787816 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c8be10e7-2171-4c85-99f2-167b0d3d5ea9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:40.788459 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c8be10e7-2171-4c85-99f2-167b0d3d5ea9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:40.871265 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-c8be10e7-2171-4c85-99f2-167b0d3d5ea9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 28625 microversion: 2.20 time: 0.103220 Dec 15 13:33:40.872728 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 226/443] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:33:40 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 28625 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:33:41.403609 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-f45fe97d-14c7-4e96-84fd-d2787b502950 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Flavor limits 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:33:41.404286 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-f45fe97d-14c7-4e96-84fd-d2787b502950 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Image limits 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:33:41.404837 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-f45fe97d-14c7-4e96-84fd-d2787b502950 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Flavor pref 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:33:41.405350 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-f45fe97d-14c7-4e96-84fd-d2787b502950 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Image pref 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:33:41.405968 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-f45fe97d-14c7-4e96-84fd-d2787b502950 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:33:41.415233 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f45fe97d-14c7-4e96-84fd-d2787b502950 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:41.415692 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f45fe97d-14c7-4e96-84fd-d2787b502950 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:41.416522 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f45fe97d-14c7-4e96-84fd-d2787b502950 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:41.416643 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-34e6f25d-ca9a-46ce-b268-0af21146d939 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:41.417075 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f45fe97d-14c7-4e96-84fd-d2787b502950 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:41.417620 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-34e6f25d-ca9a-46ce-b268-0af21146d939 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:41.424454 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-34e6f25d-ca9a-46ce-b268-0af21146d939 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:41.425151 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-34e6f25d-ca9a-46ce-b268-0af21146d939 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:41.426081 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-34e6f25d-ca9a-46ce-b268-0af21146d939 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:41.426664 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-34e6f25d-ca9a-46ce-b268-0af21146d939 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:41.437667 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-f45fe97d-14c7-4e96-84fd-d2787b502950 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Getting quotas for project 18c80dfcc63a49f7b54f89f08cd8842f. Resources: {'cores', 'instances', 'ram'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:33:41.443559 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-f45fe97d-14c7-4e96-84fd-d2787b502950 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Getting quotas for user df94523ab7c545f2a17a2cafe936d2ed and project 18c80dfcc63a49f7b54f89f08cd8842f. Resources: {'cores', 'instances', 'ram'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:33:41.459443 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-f45fe97d-14c7-4e96-84fd-d2787b502950 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Going to run 1 instances... {{(pid=116941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:33:41.461780 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-f45fe97d-14c7-4e96-84fd-d2787b502950 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 638afde5-46d2-4df0-9d04-d24b9d7aee64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cfccedbb-7169-47ec-9bae-d4829cba54e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:33:41.495242 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-34e6f25d-ca9a-46ce-b268-0af21146d939 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 28660 microversion: 2.1 time: 0.082279 Dec 15 13:33:41.495897 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 227/444] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:33:41 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 28660 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:33:41.509092 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-f45fe97d-14c7-4e96-84fd-d2787b502950 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.845963 Dec 15 13:33:41.514927 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 218/445] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Dec 15 13:33:40 2021] POST /compute/v2.1/servers => generated 380 bytes in 852 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 13:33:41.520525 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-bd6b4159-a495-4c22-875e-eef5ffe65e9f tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:41.522331 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-bd6b4159-a495-4c22-875e-eef5ffe65e9f tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 638afde5-46d2-4df0-9d04-d24b9d7aee64] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:41.616802 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-24e722ea-5dab-4a20-a190-f354cb0f3a6b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:41.617649 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-24e722ea-5dab-4a20-a190-f354cb0f3a6b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:41.618164 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-bd6b4159-a495-4c22-875e-eef5ffe65e9f tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:41.625412 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-24e722ea-5dab-4a20-a190-f354cb0f3a6b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:41.625891 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-24e722ea-5dab-4a20-a190-f354cb0f3a6b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:41.626871 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-24e722ea-5dab-4a20-a190-f354cb0f3a6b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:41.627456 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-24e722ea-5dab-4a20-a190-f354cb0f3a6b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:41.637808 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-bd6b4159-a495-4c22-875e-eef5ffe65e9f tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/638afde5-46d2-4df0-9d04-d24b9d7aee64" status: 200 len: 1218 microversion: 2.1 time: 0.121499 Dec 15 13:33:41.638408 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 228/446] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:41 2021] GET /compute/v2.1/servers/638afde5-46d2-4df0-9d04-d24b9d7aee64 => generated 1218 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:33:41.866024 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-24e722ea-5dab-4a20-a190-f354cb0f3a6b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:41.879066 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-24e722ea-5dab-4a20-a190-f354cb0f3a6b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a" status: 200 len: 1515 microversion: 2.1 time: 0.266063 Dec 15 13:33:41.882916 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-2f7a0d1b-a1af-4f71-8574-06ee4bae0ac1 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:41.884382 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-2f7a0d1b-a1af-4f71-8574-06ee4bae0ac1 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:41.890715 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2f7a0d1b-a1af-4f71-8574-06ee4bae0ac1 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:41.891205 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2f7a0d1b-a1af-4f71-8574-06ee4bae0ac1 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:41.892003 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2f7a0d1b-a1af-4f71-8574-06ee4bae0ac1 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:41.892530 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 219/447] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:41 2021] GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a => generated 1515 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:33:41.892855 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2f7a0d1b-a1af-4f71-8574-06ee4bae0ac1 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:41.965057 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-2f7a0d1b-a1af-4f71-8574-06ee4bae0ac1 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 28625 microversion: 2.20 time: 0.085652 Dec 15 13:33:41.965892 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 229/448] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:33:41 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 28625 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:33:42.508189 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-9197e79e-3d3d-4134-a531-106204c7bbc4 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:42.509094 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-9197e79e-3d3d-4134-a531-106204c7bbc4 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:42.515452 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9197e79e-3d3d-4134-a531-106204c7bbc4 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:42.516207 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9197e79e-3d3d-4134-a531-106204c7bbc4 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:42.518224 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9197e79e-3d3d-4134-a531-106204c7bbc4 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:42.520582 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9197e79e-3d3d-4134-a531-106204c7bbc4 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:42.593776 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-9197e79e-3d3d-4134-a531-106204c7bbc4 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 28660 microversion: 2.1 time: 0.089326 Dec 15 13:33:42.597751 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 220/449] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:33:42 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 28660 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:33:42.655287 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-9c22ed60-0c62-4c85-a0f9-c4dd3964a892 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:42.655995 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-9c22ed60-0c62-4c85-a0f9-c4dd3964a892 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 638afde5-46d2-4df0-9d04-d24b9d7aee64] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:42.663235 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9c22ed60-0c62-4c85-a0f9-c4dd3964a892 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:42.663683 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9c22ed60-0c62-4c85-a0f9-c4dd3964a892 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:42.664481 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9c22ed60-0c62-4c85-a0f9-c4dd3964a892 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:42.664912 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9c22ed60-0c62-4c85-a0f9-c4dd3964a892 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:42.772094 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-9c22ed60-0c62-4c85-a0f9-c4dd3964a892 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:42.782572 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-9c22ed60-0c62-4c85-a0f9-c4dd3964a892 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/638afde5-46d2-4df0-9d04-d24b9d7aee64" status: 200 len: 1270 microversion: 2.1 time: 0.131339 Dec 15 13:33:42.784029 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 230/450] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:42 2021] GET /compute/v2.1/servers/638afde5-46d2-4df0-9d04-d24b9d7aee64 => generated 1270 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:33:42.874772 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-f8f37ec5-e52b-40fa-963c-e277131acddd req-3339299f-75fb-42ec-850b-7012dea92890 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f21e20b-c80e-408b-849e-cf9e27127cbb", "tag": "f90cb0df-c11c-44a8-b09b-274188bbac57"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:42.877495 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:33:42.877495 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: warnings.warn(msg) Dec 15 13:33:42.887746 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-f8f37ec5-e52b-40fa-963c-e277131acddd req-3339299f-75fb-42ec-850b-7012dea92890 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:42.888322 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-f8f37ec5-e52b-40fa-963c-e277131acddd req-3339299f-75fb-42ec-850b-7012dea92890 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:42.912224 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-f8f37ec5-e52b-40fa-963c-e277131acddd req-3339299f-75fb-42ec-850b-7012dea92890 service nova] Creating event network-changed:f90cb0df-c11c-44a8-b09b-274188bbac57 for instance 9f21e20b-c80e-408b-849e-cf9e27127cbb on hv-cinder-81322 Dec 15 13:33:42.918238 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-f8f37ec5-e52b-40fa-963c-e277131acddd req-3339299f-75fb-42ec-850b-7012dea92890 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049469 Dec 15 13:33:42.919137 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 221/451] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:33:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:33:42.977189 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-01a0ec0b-9568-49d0-8cc9-ae4403373abd tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:42.978444 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-01a0ec0b-9568-49d0-8cc9-ae4403373abd tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:42.985477 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-01a0ec0b-9568-49d0-8cc9-ae4403373abd tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:42.986182 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-01a0ec0b-9568-49d0-8cc9-ae4403373abd tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:42.987182 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-01a0ec0b-9568-49d0-8cc9-ae4403373abd tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:42.987773 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-01a0ec0b-9568-49d0-8cc9-ae4403373abd tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:43.081463 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-01a0ec0b-9568-49d0-8cc9-ae4403373abd tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 28625 microversion: 2.20 time: 0.107685 Dec 15 13:33:43.082993 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 231/452] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:33:42 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 28625 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:33:43.321463 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-c63dc29b-0643-4251-b7a5-53679aab7319 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:43.322777 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-c63dc29b-0643-4251-b7a5-53679aab7319 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:43.330336 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c63dc29b-0643-4251-b7a5-53679aab7319 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:43.331203 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c63dc29b-0643-4251-b7a5-53679aab7319 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:43.332334 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c63dc29b-0643-4251-b7a5-53679aab7319 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:43.332939 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c63dc29b-0643-4251-b7a5-53679aab7319 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:43.506438 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-c63dc29b-0643-4251-b7a5-53679aab7319 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:43.515088 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-c63dc29b-0643-4251-b7a5-53679aab7319 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a" status: 200 len: 1515 microversion: 2.1 time: 0.198857 Dec 15 13:33:43.515995 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 222/453] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:43 2021] GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a => generated 1515 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:33:43.532482 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-8e1e3117-c2d5-4c8f-99ad-8052ebb95441 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "12c3c743-9c46-452e-b4d2-b91656962919"}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:43.533884 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-8e1e3117-c2d5-4c8f-99ad-8052ebb95441 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:43.540715 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8e1e3117-c2d5-4c8f-99ad-8052ebb95441 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:43.541172 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8e1e3117-c2d5-4c8f-99ad-8052ebb95441 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:43.541971 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8e1e3117-c2d5-4c8f-99ad-8052ebb95441 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:43.542414 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8e1e3117-c2d5-4c8f-99ad-8052ebb95441 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:43.606998 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-bd0386f9-d46d-486e-94c4-2bd426a46dbe tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:43.609098 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-bd0386f9-d46d-486e-94c4-2bd426a46dbe tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:43.619540 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bd0386f9-d46d-486e-94c4-2bd426a46dbe tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:43.620642 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bd0386f9-d46d-486e-94c4-2bd426a46dbe tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:43.621766 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bd0386f9-d46d-486e-94c4-2bd426a46dbe tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:43.622304 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bd0386f9-d46d-486e-94c4-2bd426a46dbe tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:43.816524 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-bd0386f9-d46d-486e-94c4-2bd426a46dbe tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 28660 microversion: 2.1 time: 0.214315 Dec 15 13:33:43.817473 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 223/454] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:33:43 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 28660 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:33:43.826116 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-302ec5b5-0db6-46f0-bd9a-febc953cc098 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:43.827937 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-302ec5b5-0db6-46f0-bd9a-febc953cc098 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 638afde5-46d2-4df0-9d04-d24b9d7aee64] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:43.846046 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-302ec5b5-0db6-46f0-bd9a-febc953cc098 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:43.846687 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-302ec5b5-0db6-46f0-bd9a-febc953cc098 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:43.847598 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-302ec5b5-0db6-46f0-bd9a-febc953cc098 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:43.848045 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-302ec5b5-0db6-46f0-bd9a-febc953cc098 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:44.090805 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-8e1e3117-c2d5-4c8f-99ad-8052ebb95441 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "POST /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.562424 Dec 15 13:33:44.094114 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 232/455] 10.222.0.60 () {60 vars in 1322 bytes} [Wed Dec 15 13:33:43 2021] POST /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a/os-volume_attachments => generated 194 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:33:44.100623 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-29b5003a-02ab-4f17-b041-b19c6708bc5d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:44.102040 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-29b5003a-02ab-4f17-b041-b19c6708bc5d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:44.114247 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-29b5003a-02ab-4f17-b041-b19c6708bc5d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:44.115109 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-29b5003a-02ab-4f17-b041-b19c6708bc5d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:44.116150 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-29b5003a-02ab-4f17-b041-b19c6708bc5d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:44.116791 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-29b5003a-02ab-4f17-b041-b19c6708bc5d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:44.196314 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-302ec5b5-0db6-46f0-bd9a-febc953cc098 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:44.209528 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-302ec5b5-0db6-46f0-bd9a-febc953cc098 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/638afde5-46d2-4df0-9d04-d24b9d7aee64" status: 200 len: 1318 microversion: 2.1 time: 0.386806 Dec 15 13:33:44.210246 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 224/456] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:43 2021] GET /compute/v2.1/servers/638afde5-46d2-4df0-9d04-d24b9d7aee64 => generated 1318 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:33:44.219508 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-29b5003a-02ab-4f17-b041-b19c6708bc5d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 28625 microversion: 2.20 time: 0.123561 Dec 15 13:33:44.221404 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 233/457] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:33:44 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 28625 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:33:44.620678 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-4fe59b3e-0943-4ec2-9d5a-f9c5bb647332 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1625398936"}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:44.621284 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-4fe59b3e-0943-4ec2-9d5a-f9c5bb647332 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:44.629443 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4fe59b3e-0943-4ec2-9d5a-f9c5bb647332 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:44.630074 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4fe59b3e-0943-4ec2-9d5a-f9c5bb647332 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:44.631069 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4fe59b3e-0943-4ec2-9d5a-f9c5bb647332 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:44.631513 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4fe59b3e-0943-4ec2-9d5a-f9c5bb647332 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:44.788799 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-a9c69262-87a7-4ba4-af15-4335c7e09257 req-e8a8c603-53bc-42b4-8e3e-87a01703d057 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "638afde5-46d2-4df0-9d04-d24b9d7aee64", "tag": "73028c18-6a30-4deb-9114-51244b03f4f4"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:44.790970 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:33:44.790970 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: warnings.warn(msg) Dec 15 13:33:44.801437 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-a9c69262-87a7-4ba4-af15-4335c7e09257 req-e8a8c603-53bc-42b4-8e3e-87a01703d057 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:44.802094 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-a9c69262-87a7-4ba4-af15-4335c7e09257 req-e8a8c603-53bc-42b4-8e3e-87a01703d057 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:44.821379 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-a9c69262-87a7-4ba4-af15-4335c7e09257 req-e8a8c603-53bc-42b4-8e3e-87a01703d057 service nova] Creating event network-changed:73028c18-6a30-4deb-9114-51244b03f4f4 for instance 638afde5-46d2-4df0-9d04-d24b9d7aee64 on hv-cinder-81322 Dec 15 13:33:44.825453 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.network.security_group_api [None req-4fe59b3e-0943-4ec2-9d5a-f9c5bb647332 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Adding security group 38c7b061-13d4-4935-b838-e335d76ae1b9 to port f90cb0df-c11c-44a8-b09b-274188bbac57 Dec 15 13:33:44.827389 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-a9c69262-87a7-4ba4-af15-4335c7e09257 req-e8a8c603-53bc-42b4-8e3e-87a01703d057 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044241 Dec 15 13:33:44.828606 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 234/458] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:33:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:33:44.833763 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ebcaab00-2792-43d9-942f-42ce189007c8 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:44.835258 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ebcaab00-2792-43d9-942f-42ce189007c8 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:44.842039 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ebcaab00-2792-43d9-942f-42ce189007c8 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:44.842631 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ebcaab00-2792-43d9-942f-42ce189007c8 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:44.843628 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ebcaab00-2792-43d9-942f-42ce189007c8 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:44.844164 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ebcaab00-2792-43d9-942f-42ce189007c8 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:44.917942 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ebcaab00-2792-43d9-942f-42ce189007c8 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 28660 microversion: 2.1 time: 0.087462 Dec 15 13:33:44.922602 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 235/459] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:33:44 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 28660 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:33:45.237321 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-9a0e5966-5833-4b16-beff-3a1527fdbf42 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:45.238149 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-9a0e5966-5833-4b16-beff-3a1527fdbf42 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 638afde5-46d2-4df0-9d04-d24b9d7aee64] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:45.255212 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9a0e5966-5833-4b16-beff-3a1527fdbf42 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:45.255838 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9a0e5966-5833-4b16-beff-3a1527fdbf42 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:45.256916 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9a0e5966-5833-4b16-beff-3a1527fdbf42 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:45.257687 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9a0e5966-5833-4b16-beff-3a1527fdbf42 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:45.279295 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-4fe59b3e-0943-4ec2-9d5a-f9c5bb647332 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "POST /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb/action" status: 202 len: 0 microversion: 2.1 time: 0.662685 Dec 15 13:33:45.280500 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 225/460] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:33:44 2021] POST /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb/action => generated 0 bytes in 665 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:33:45.289025 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-ab905b17-85fa-4721-8d46-72b729c2057b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:45.290003 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-ab905b17-85fa-4721-8d46-72b729c2057b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:45.305615 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ab905b17-85fa-4721-8d46-72b729c2057b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:45.306916 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ab905b17-85fa-4721-8d46-72b729c2057b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:45.307841 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ab905b17-85fa-4721-8d46-72b729c2057b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:45.308292 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ab905b17-85fa-4721-8d46-72b729c2057b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:45.408397 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-ab905b17-85fa-4721-8d46-72b729c2057b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 28625 microversion: 2.20 time: 0.121628 Dec 15 13:33:45.409377 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 226/461] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:33:45 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 28625 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:33:45.427976 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-f7b8b38e-925b-4a51-86e2-ec554fa89e4a req-4005bf69-d17a-42d6-b00c-1222587ddb22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f21e20b-c80e-408b-849e-cf9e27127cbb", "tag": "f90cb0df-c11c-44a8-b09b-274188bbac57"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:45.430524 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:33:45.430524 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: warnings.warn(msg) Dec 15 13:33:45.443344 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-f7b8b38e-925b-4a51-86e2-ec554fa89e4a req-4005bf69-d17a-42d6-b00c-1222587ddb22 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:45.444201 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-f7b8b38e-925b-4a51-86e2-ec554fa89e4a req-4005bf69-d17a-42d6-b00c-1222587ddb22 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:45.458474 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-f7b8b38e-925b-4a51-86e2-ec554fa89e4a req-4005bf69-d17a-42d6-b00c-1222587ddb22 service nova] Creating event network-changed:f90cb0df-c11c-44a8-b09b-274188bbac57 for instance 9f21e20b-c80e-408b-849e-cf9e27127cbb on hv-cinder-81322 Dec 15 13:33:45.458737 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-9a0e5966-5833-4b16-beff-3a1527fdbf42 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:45.464998 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-f7b8b38e-925b-4a51-86e2-ec554fa89e4a req-4005bf69-d17a-42d6-b00c-1222587ddb22 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042728 Dec 15 13:33:45.465785 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 227/462] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:33:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:33:45.476358 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-228d1774-9f4b-4e87-b364-85550bd87017 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:45.479837 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-228d1774-9f4b-4e87-b364-85550bd87017 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:45.489601 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-9a0e5966-5833-4b16-beff-3a1527fdbf42 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/638afde5-46d2-4df0-9d04-d24b9d7aee64" status: 200 len: 1318 microversion: 2.1 time: 0.263974 Dec 15 13:33:45.499218 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 236/463] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:45 2021] GET /compute/v2.1/servers/638afde5-46d2-4df0-9d04-d24b9d7aee64 => generated 1318 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:33:45.499327 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-228d1774-9f4b-4e87-b364-85550bd87017 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:45.499327 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-228d1774-9f4b-4e87-b364-85550bd87017 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:45.499327 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-228d1774-9f4b-4e87-b364-85550bd87017 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:45.499327 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-228d1774-9f4b-4e87-b364-85550bd87017 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:45.676338 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-228d1774-9f4b-4e87-b364-85550bd87017 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed1331bcb0e4fe4a53379d1d72f650a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38faa56e5864d3aba51e1e8351e3a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:45.685378 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-228d1774-9f4b-4e87-b364-85550bd87017 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb" status: 200 len: 1758 microversion: 2.1 time: 0.218278 Dec 15 13:33:45.689517 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 228/464] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:45 2021] GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb => generated 1758 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:33:45.930443 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-04306b14-662c-4a50-979f-2c0f65bdb398 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:45.931442 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-04306b14-662c-4a50-979f-2c0f65bdb398 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:45.938510 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-04306b14-662c-4a50-979f-2c0f65bdb398 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:45.938986 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-04306b14-662c-4a50-979f-2c0f65bdb398 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:45.939777 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-04306b14-662c-4a50-979f-2c0f65bdb398 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:45.940338 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-04306b14-662c-4a50-979f-2c0f65bdb398 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:46.015919 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-04306b14-662c-4a50-979f-2c0f65bdb398 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 28660 microversion: 2.1 time: 0.089506 Dec 15 13:33:46.016751 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 237/465] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:33:45 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 28660 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:33:46.420209 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-58558c41-f97d-463c-9f99-cf361901c0ad tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:46.421649 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-58558c41-f97d-463c-9f99-cf361901c0ad tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:46.427832 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-58558c41-f97d-463c-9f99-cf361901c0ad tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:46.428283 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-58558c41-f97d-463c-9f99-cf361901c0ad tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:46.429070 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-58558c41-f97d-463c-9f99-cf361901c0ad tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:46.429510 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-58558c41-f97d-463c-9f99-cf361901c0ad tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:46.506274 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-2b8fbb6d-9fbe-438b-8b4a-f1651b217681 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:46.507122 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-2b8fbb6d-9fbe-438b-8b4a-f1651b217681 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 638afde5-46d2-4df0-9d04-d24b9d7aee64] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:46.514144 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2b8fbb6d-9fbe-438b-8b4a-f1651b217681 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:46.514601 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2b8fbb6d-9fbe-438b-8b4a-f1651b217681 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:46.515427 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2b8fbb6d-9fbe-438b-8b4a-f1651b217681 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:46.515872 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2b8fbb6d-9fbe-438b-8b4a-f1651b217681 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:46.657143 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-2b8fbb6d-9fbe-438b-8b4a-f1651b217681 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:46.666086 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-2b8fbb6d-9fbe-438b-8b4a-f1651b217681 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/638afde5-46d2-4df0-9d04-d24b9d7aee64" status: 200 len: 1318 microversion: 2.1 time: 0.163853 Dec 15 13:33:46.666664 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 238/466] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:46 2021] GET /compute/v2.1/servers/638afde5-46d2-4df0-9d04-d24b9d7aee64 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:33:46.742530 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-58558c41-f97d-463c-9f99-cf361901c0ad tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 28625 microversion: 2.20 time: 0.325869 Dec 15 13:33:46.747184 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 229/467] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:33:46 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 28625 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:33:47.028580 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-08878cc6-93c6-4343-9f14-b2facb91b0bc tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:47.030496 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-08878cc6-93c6-4343-9f14-b2facb91b0bc tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:47.037814 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-08878cc6-93c6-4343-9f14-b2facb91b0bc tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:47.038344 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-08878cc6-93c6-4343-9f14-b2facb91b0bc tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:47.039257 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-08878cc6-93c6-4343-9f14-b2facb91b0bc tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:47.039864 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-08878cc6-93c6-4343-9f14-b2facb91b0bc tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:47.125244 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-08878cc6-93c6-4343-9f14-b2facb91b0bc tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 28660 microversion: 2.1 time: 0.101683 Dec 15 13:33:47.126104 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 239/468] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:33:47 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 28660 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:33:47.682753 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-364ada0f-3e3e-40ab-a613-1b6fefe03a8c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:47.683488 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-364ada0f-3e3e-40ab-a613-1b6fefe03a8c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 638afde5-46d2-4df0-9d04-d24b9d7aee64] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:47.691438 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-364ada0f-3e3e-40ab-a613-1b6fefe03a8c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:47.691894 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-364ada0f-3e3e-40ab-a613-1b6fefe03a8c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:47.692688 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-364ada0f-3e3e-40ab-a613-1b6fefe03a8c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:47.693627 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-364ada0f-3e3e-40ab-a613-1b6fefe03a8c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:47.763688 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ece59b72-5b89-46e0-a2c1-7142d50ce369 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:47.764785 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ece59b72-5b89-46e0-a2c1-7142d50ce369 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:47.772861 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ece59b72-5b89-46e0-a2c1-7142d50ce369 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:47.772861 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ece59b72-5b89-46e0-a2c1-7142d50ce369 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:47.773643 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ece59b72-5b89-46e0-a2c1-7142d50ce369 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:47.774085 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ece59b72-5b89-46e0-a2c1-7142d50ce369 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:47.831431 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-364ada0f-3e3e-40ab-a613-1b6fefe03a8c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:47.838982 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-364ada0f-3e3e-40ab-a613-1b6fefe03a8c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/638afde5-46d2-4df0-9d04-d24b9d7aee64" status: 200 len: 1318 microversion: 2.1 time: 0.160042 Dec 15 13:33:47.839723 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 230/469] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:47 2021] GET /compute/v2.1/servers/638afde5-46d2-4df0-9d04-d24b9d7aee64 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:33:47.840012 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ece59b72-5b89-46e0-a2c1-7142d50ce369 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 28625 microversion: 2.20 time: 0.087912 Dec 15 13:33:47.840758 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 240/470] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:33:47 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 28625 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:33:48.137049 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-63f0109d-a9cf-40da-95de-c8769070a5b3 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:48.138532 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-63f0109d-a9cf-40da-95de-c8769070a5b3 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:48.145862 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-63f0109d-a9cf-40da-95de-c8769070a5b3 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:48.146346 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-63f0109d-a9cf-40da-95de-c8769070a5b3 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:48.147188 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-63f0109d-a9cf-40da-95de-c8769070a5b3 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:48.147718 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-63f0109d-a9cf-40da-95de-c8769070a5b3 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:48.230736 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-63f0109d-a9cf-40da-95de-c8769070a5b3 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 28660 microversion: 2.1 time: 0.094245 Dec 15 13:33:48.230736 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 231/471] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:33:48 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 28660 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:33:48.852686 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-b8dba0ae-b21b-4d9c-b78c-8231c9c14cbc tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:48.853796 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-b8dba0ae-b21b-4d9c-b78c-8231c9c14cbc tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:48.856308 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-3838d3b4-a6a7-48b2-9768-d95a8b89217e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:48.857099 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-3838d3b4-a6a7-48b2-9768-d95a8b89217e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 638afde5-46d2-4df0-9d04-d24b9d7aee64] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:48.861540 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b8dba0ae-b21b-4d9c-b78c-8231c9c14cbc tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:48.861915 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b8dba0ae-b21b-4d9c-b78c-8231c9c14cbc tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:48.862711 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b8dba0ae-b21b-4d9c-b78c-8231c9c14cbc tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:48.863184 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b8dba0ae-b21b-4d9c-b78c-8231c9c14cbc tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:48.865906 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3838d3b4-a6a7-48b2-9768-d95a8b89217e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:48.867584 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3838d3b4-a6a7-48b2-9768-d95a8b89217e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:48.867584 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3838d3b4-a6a7-48b2-9768-d95a8b89217e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:48.867912 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3838d3b4-a6a7-48b2-9768-d95a8b89217e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:48.942077 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-b8dba0ae-b21b-4d9c-b78c-8231c9c14cbc tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 28625 microversion: 2.20 time: 0.093347 Dec 15 13:33:48.942730 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 241/472] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:33:48 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 28625 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:33:49.004808 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-3838d3b4-a6a7-48b2-9768-d95a8b89217e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:49.011985 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-3838d3b4-a6a7-48b2-9768-d95a8b89217e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/638afde5-46d2-4df0-9d04-d24b9d7aee64" status: 200 len: 1318 microversion: 2.1 time: 0.159963 Dec 15 13:33:49.012679 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 232/473] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:48 2021] GET /compute/v2.1/servers/638afde5-46d2-4df0-9d04-d24b9d7aee64 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:33:49.240543 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-544c526a-cfed-4939-a5ba-4a3c1ec58a2c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:49.241702 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-544c526a-cfed-4939-a5ba-4a3c1ec58a2c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:49.247925 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-544c526a-cfed-4939-a5ba-4a3c1ec58a2c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:49.248404 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-544c526a-cfed-4939-a5ba-4a3c1ec58a2c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:49.249185 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-544c526a-cfed-4939-a5ba-4a3c1ec58a2c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:49.249690 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-544c526a-cfed-4939-a5ba-4a3c1ec58a2c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:49.347177 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-544c526a-cfed-4939-a5ba-4a3c1ec58a2c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 28660 microversion: 2.1 time: 0.111143 Dec 15 13:33:49.349219 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 242/474] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:33:49 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 28660 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:33:49.954088 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-b927cb7f-3b3e-4282-a5b4-5651104a10a6 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:49.954961 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-b927cb7f-3b3e-4282-a5b4-5651104a10a6 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:49.961193 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b927cb7f-3b3e-4282-a5b4-5651104a10a6 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:49.961644 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b927cb7f-3b3e-4282-a5b4-5651104a10a6 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:49.962423 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b927cb7f-3b3e-4282-a5b4-5651104a10a6 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:49.962868 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b927cb7f-3b3e-4282-a5b4-5651104a10a6 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:50.030101 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-c09b0f8f-a3f8-40c0-94fe-b8617c14b322 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:50.030800 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-c09b0f8f-a3f8-40c0-94fe-b8617c14b322 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 638afde5-46d2-4df0-9d04-d24b9d7aee64] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:50.033824 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-b927cb7f-3b3e-4282-a5b4-5651104a10a6 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 28625 microversion: 2.20 time: 0.083934 Dec 15 13:33:50.034660 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 233/475] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:33:49 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 28625 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:33:50.037669 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c09b0f8f-a3f8-40c0-94fe-b8617c14b322 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:50.038129 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c09b0f8f-a3f8-40c0-94fe-b8617c14b322 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:50.038935 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c09b0f8f-a3f8-40c0-94fe-b8617c14b322 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:50.039374 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c09b0f8f-a3f8-40c0-94fe-b8617c14b322 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:50.164984 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-c09b0f8f-a3f8-40c0-94fe-b8617c14b322 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:50.172234 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-c09b0f8f-a3f8-40c0-94fe-b8617c14b322 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/638afde5-46d2-4df0-9d04-d24b9d7aee64" status: 200 len: 1318 microversion: 2.1 time: 0.146742 Dec 15 13:33:50.172794 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 243/476] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:50 2021] GET /compute/v2.1/servers/638afde5-46d2-4df0-9d04-d24b9d7aee64 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:33:50.360575 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-ff79ea7a-96fc-467c-9102-752274958973 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:50.369626 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-ff79ea7a-96fc-467c-9102-752274958973 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:50.378724 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ff79ea7a-96fc-467c-9102-752274958973 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:50.379201 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ff79ea7a-96fc-467c-9102-752274958973 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:50.379993 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ff79ea7a-96fc-467c-9102-752274958973 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:50.380428 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ff79ea7a-96fc-467c-9102-752274958973 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:50.518818 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-ff79ea7a-96fc-467c-9102-752274958973 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 28660 microversion: 2.1 time: 0.162132 Dec 15 13:33:50.522821 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 234/477] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:33:50 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 28660 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:33:51.044740 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-5ed0faef-3a8e-43b0-a1ad-c44dd9ef6fdc tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:51.046275 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-5ed0faef-3a8e-43b0-a1ad-c44dd9ef6fdc tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:51.052456 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5ed0faef-3a8e-43b0-a1ad-c44dd9ef6fdc tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:51.052922 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5ed0faef-3a8e-43b0-a1ad-c44dd9ef6fdc tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:51.053709 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5ed0faef-3a8e-43b0-a1ad-c44dd9ef6fdc tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:51.054155 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5ed0faef-3a8e-43b0-a1ad-c44dd9ef6fdc tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:51.123357 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-5ed0faef-3a8e-43b0-a1ad-c44dd9ef6fdc tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 28625 microversion: 2.20 time: 0.082190 Dec 15 13:33:51.124888 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 244/478] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:33:51 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 28625 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:33:51.189364 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-24d230b3-a5d4-4117-b59d-e70365071e90 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:51.190060 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-24d230b3-a5d4-4117-b59d-e70365071e90 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 638afde5-46d2-4df0-9d04-d24b9d7aee64] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:51.197119 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-24d230b3-a5d4-4117-b59d-e70365071e90 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:51.197561 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-24d230b3-a5d4-4117-b59d-e70365071e90 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:51.198333 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-24d230b3-a5d4-4117-b59d-e70365071e90 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:51.198762 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-24d230b3-a5d4-4117-b59d-e70365071e90 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:51.337472 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-24d230b3-a5d4-4117-b59d-e70365071e90 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:51.345273 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-24d230b3-a5d4-4117-b59d-e70365071e90 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/638afde5-46d2-4df0-9d04-d24b9d7aee64" status: 200 len: 1318 microversion: 2.1 time: 0.160111 Dec 15 13:33:51.345842 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 235/479] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:51 2021] GET /compute/v2.1/servers/638afde5-46d2-4df0-9d04-d24b9d7aee64 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:33:51.531393 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-03e0fbb7-f1cd-4d0e-a1a3-fe7afa70607d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:51.532665 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-03e0fbb7-f1cd-4d0e-a1a3-fe7afa70607d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:51.540042 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-03e0fbb7-f1cd-4d0e-a1a3-fe7afa70607d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:51.540763 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-03e0fbb7-f1cd-4d0e-a1a3-fe7afa70607d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:51.541686 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-03e0fbb7-f1cd-4d0e-a1a3-fe7afa70607d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:51.542247 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-03e0fbb7-f1cd-4d0e-a1a3-fe7afa70607d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:51.621519 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-03e0fbb7-f1cd-4d0e-a1a3-fe7afa70607d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 28660 microversion: 2.1 time: 0.094878 Dec 15 13:33:51.622174 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 245/480] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:33:51 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 28660 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:33:51.651220 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-3d444c5a-fc12-4c31-abd8-49c903589315 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:51.652152 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-3d444c5a-fc12-4c31-abd8-49c903589315 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:51.658557 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3d444c5a-fc12-4c31-abd8-49c903589315 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:51.659048 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3d444c5a-fc12-4c31-abd8-49c903589315 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:51.659829 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3d444c5a-fc12-4c31-abd8-49c903589315 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:51.660259 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3d444c5a-fc12-4c31-abd8-49c903589315 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:51.682687 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.objects.instance [None req-3d444c5a-fc12-4c31-abd8-49c903589315 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lazy-loading 'flavor' on Instance uuid eab2a5ce-9a56-4120-ae3c-ddfb844aa30a {{(pid=116941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:33:51.838524 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-3d444c5a-fc12-4c31-abd8-49c903589315 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "POST /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a/action" status: 200 len: 32 microversion: 2.1 time: 0.190933 Dec 15 13:33:51.839097 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 236/481] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:33:51 2021] POST /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a/action => generated 32 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:33:51.848402 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-a832ba3b-540d-4563-b28d-fd7b7c0d78c0 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:51.849111 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-a832ba3b-540d-4563-b28d-fd7b7c0d78c0 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:51.856327 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a832ba3b-540d-4563-b28d-fd7b7c0d78c0 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:51.856781 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a832ba3b-540d-4563-b28d-fd7b7c0d78c0 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:51.857728 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a832ba3b-540d-4563-b28d-fd7b7c0d78c0 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:51.858202 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a832ba3b-540d-4563-b28d-fd7b7c0d78c0 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:51.995910 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-a832ba3b-540d-4563-b28d-fd7b7c0d78c0 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:52.004109 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-a832ba3b-540d-4563-b28d-fd7b7c0d78c0 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a" status: 200 len: 1567 microversion: 2.1 time: 0.159627 Dec 15 13:33:52.004686 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 246/482] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:51 2021] GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:33:52.136014 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-62b2de19-1012-4eb3-a2e2-509e2e8ec0d5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:52.137026 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-62b2de19-1012-4eb3-a2e2-509e2e8ec0d5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:52.143887 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-62b2de19-1012-4eb3-a2e2-509e2e8ec0d5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:52.144344 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-62b2de19-1012-4eb3-a2e2-509e2e8ec0d5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:52.145135 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-62b2de19-1012-4eb3-a2e2-509e2e8ec0d5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:52.145576 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-62b2de19-1012-4eb3-a2e2-509e2e8ec0d5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:52.361882 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-e67264e4-0675-4c2d-b9b1-aa8409591978 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:52.362491 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-e67264e4-0675-4c2d-b9b1-aa8409591978 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 638afde5-46d2-4df0-9d04-d24b9d7aee64] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:52.368969 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e67264e4-0675-4c2d-b9b1-aa8409591978 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:52.369416 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e67264e4-0675-4c2d-b9b1-aa8409591978 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:52.370200 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e67264e4-0675-4c2d-b9b1-aa8409591978 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:52.370635 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e67264e4-0675-4c2d-b9b1-aa8409591978 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:52.497841 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-e67264e4-0675-4c2d-b9b1-aa8409591978 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:52.505062 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-e67264e4-0675-4c2d-b9b1-aa8409591978 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/638afde5-46d2-4df0-9d04-d24b9d7aee64" status: 200 len: 1318 microversion: 2.1 time: 0.147472 Dec 15 13:33:52.505669 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 247/483] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:52 2021] GET /compute/v2.1/servers/638afde5-46d2-4df0-9d04-d24b9d7aee64 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:33:52.633336 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-f1827a63-fa6f-46f2-832b-e772298dc6aa tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:52.634296 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-f1827a63-fa6f-46f2-832b-e772298dc6aa tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:52.640562 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f1827a63-fa6f-46f2-832b-e772298dc6aa tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:52.641013 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f1827a63-fa6f-46f2-832b-e772298dc6aa tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:52.641781 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f1827a63-fa6f-46f2-832b-e772298dc6aa tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:52.642225 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f1827a63-fa6f-46f2-832b-e772298dc6aa tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:56.661906 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-62b2de19-1012-4eb3-a2e2-509e2e8ec0d5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 28625 microversion: 2.20 time: 4.530172 Dec 15 13:33:56.662558 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 237/484] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:33:52 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 28625 bytes in 4532 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:33:56.667755 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-fa0419f1-f42f-46d1-a8f7-77dc7568ae63 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:56.668458 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-fa0419f1-f42f-46d1-a8f7-77dc7568ae63 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:56.670991 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-f1827a63-fa6f-46f2-832b-e772298dc6aa tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 28660 microversion: 2.1 time: 4.041015 Dec 15 13:33:56.671827 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 248/485] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:33:52 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 28660 bytes in 4043 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:33:56.676600 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-fa0419f1-f42f-46d1-a8f7-77dc7568ae63 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:56.676820 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-e226f370-8722-4134-afcd-033ca68536ca tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:56.677057 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-fa0419f1-f42f-46d1-a8f7-77dc7568ae63 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:56.677459 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-e226f370-8722-4134-afcd-033ca68536ca tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 638afde5-46d2-4df0-9d04-d24b9d7aee64] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:56.677846 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-fa0419f1-f42f-46d1-a8f7-77dc7568ae63 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:56.678288 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-fa0419f1-f42f-46d1-a8f7-77dc7568ae63 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:56.684720 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e226f370-8722-4134-afcd-033ca68536ca tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:56.685883 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e226f370-8722-4134-afcd-033ca68536ca tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:56.690923 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e226f370-8722-4134-afcd-033ca68536ca tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:56.690923 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e226f370-8722-4134-afcd-033ca68536ca tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:56.872028 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-fa0419f1-f42f-46d1-a8f7-77dc7568ae63 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:56.879724 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-e226f370-8722-4134-afcd-033ca68536ca tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:56.880344 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-fa0419f1-f42f-46d1-a8f7-77dc7568ae63 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a" status: 200 len: 1567 microversion: 2.1 time: 0.216574 Dec 15 13:33:56.880914 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 238/486] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:56 2021] GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a => generated 1567 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:33:56.887155 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-e226f370-8722-4134-afcd-033ca68536ca tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/638afde5-46d2-4df0-9d04-d24b9d7aee64" status: 200 len: 1318 microversion: 2.1 time: 0.214403 Dec 15 13:33:56.887720 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 249/487] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:56 2021] GET /compute/v2.1/servers/638afde5-46d2-4df0-9d04-d24b9d7aee64 => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:33:57.673520 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-d58efd7f-4525-491e-b1db-c62e0b5bbb71 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:57.674497 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-d58efd7f-4525-491e-b1db-c62e0b5bbb71 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:57.680866 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d58efd7f-4525-491e-b1db-c62e0b5bbb71 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:57.681323 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d58efd7f-4525-491e-b1db-c62e0b5bbb71 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:57.681995 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-4ba49bea-0dab-447f-818b-27e8c1cec4ca tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:57.682396 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d58efd7f-4525-491e-b1db-c62e0b5bbb71 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:57.682530 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d58efd7f-4525-491e-b1db-c62e0b5bbb71 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:57.682925 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-4ba49bea-0dab-447f-818b-27e8c1cec4ca tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:57.689655 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4ba49bea-0dab-447f-818b-27e8c1cec4ca tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:57.690112 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4ba49bea-0dab-447f-818b-27e8c1cec4ca tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:57.690933 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4ba49bea-0dab-447f-818b-27e8c1cec4ca tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:57.691378 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4ba49bea-0dab-447f-818b-27e8c1cec4ca tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:57.758198 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-d58efd7f-4525-491e-b1db-c62e0b5bbb71 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 28625 microversion: 2.20 time: 0.088208 Dec 15 13:33:57.759476 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 239/488] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:33:57 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 28625 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:33:57.761835 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-4ba49bea-0dab-447f-818b-27e8c1cec4ca tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 28660 microversion: 2.1 time: 0.083234 Dec 15 13:33:57.762886 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 250/489] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:33:57 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 28660 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:33:57.897480 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-b27d18e2-73e5-4fbd-b6ef-97655a352e14 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:57.898188 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-b27d18e2-73e5-4fbd-b6ef-97655a352e14 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:57.904118 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-0834894d-cbd8-4356-a638-459e364a64f8 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:57.905011 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-0834894d-cbd8-4356-a638-459e364a64f8 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 638afde5-46d2-4df0-9d04-d24b9d7aee64] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:57.905129 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b27d18e2-73e5-4fbd-b6ef-97655a352e14 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:57.905582 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b27d18e2-73e5-4fbd-b6ef-97655a352e14 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:57.906375 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b27d18e2-73e5-4fbd-b6ef-97655a352e14 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:57.906811 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b27d18e2-73e5-4fbd-b6ef-97655a352e14 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:57.911258 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0834894d-cbd8-4356-a638-459e364a64f8 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:57.911713 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0834894d-cbd8-4356-a638-459e364a64f8 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:57.912736 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0834894d-cbd8-4356-a638-459e364a64f8 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:57.913180 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0834894d-cbd8-4356-a638-459e364a64f8 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:58.104085 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-b27d18e2-73e5-4fbd-b6ef-97655a352e14 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:58.108248 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-0834894d-cbd8-4356-a638-459e364a64f8 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:58.112564 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-b27d18e2-73e5-4fbd-b6ef-97655a352e14 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a" status: 200 len: 1567 microversion: 2.1 time: 0.219119 Dec 15 13:33:58.113251 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 240/490] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:57 2021] GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a => generated 1567 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:33:58.115579 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-0834894d-cbd8-4356-a638-459e364a64f8 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/638afde5-46d2-4df0-9d04-d24b9d7aee64" status: 200 len: 1318 microversion: 2.1 time: 0.215560 Dec 15 13:33:58.116145 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 251/491] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:57 2021] GET /compute/v2.1/servers/638afde5-46d2-4df0-9d04-d24b9d7aee64 => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:33:58.769890 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-60d2c6a3-e57d-45bf-97b7-c7b34aeea6c1 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:58.770952 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-60d2c6a3-e57d-45bf-97b7-c7b34aeea6c1 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:58.774298 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-2ef183b1-7d2f-4df2-b199-10a6e98ea9ee tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:58.775362 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-2ef183b1-7d2f-4df2-b199-10a6e98ea9ee tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:58.777586 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-60d2c6a3-e57d-45bf-97b7-c7b34aeea6c1 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:58.778045 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-60d2c6a3-e57d-45bf-97b7-c7b34aeea6c1 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:58.779600 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-60d2c6a3-e57d-45bf-97b7-c7b34aeea6c1 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:58.779897 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-60d2c6a3-e57d-45bf-97b7-c7b34aeea6c1 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:58.782645 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2ef183b1-7d2f-4df2-b199-10a6e98ea9ee tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:58.783136 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2ef183b1-7d2f-4df2-b199-10a6e98ea9ee tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:58.783925 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2ef183b1-7d2f-4df2-b199-10a6e98ea9ee tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:58.784360 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2ef183b1-7d2f-4df2-b199-10a6e98ea9ee tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:58.858752 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-60d2c6a3-e57d-45bf-97b7-c7b34aeea6c1 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 28625 microversion: 2.20 time: 0.092262 Dec 15 13:33:58.860210 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 241/492] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:33:58 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 28625 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:33:58.863687 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-2ef183b1-7d2f-4df2-b199-10a6e98ea9ee tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 28660 microversion: 2.1 time: 0.093096 Dec 15 13:33:58.864328 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 252/493] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:33:58 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 28660 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:33:58.864741 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-c1776c0d-84f5-4191-8c77-feb31d7eb06c req-b1ba085e-5958-4338-9a19-b3c8d9250e83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "638afde5-46d2-4df0-9d04-d24b9d7aee64", "name": "network-vif-plugged", "status": "completed", "tag": "73028c18-6a30-4deb-9114-51244b03f4f4"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:58.866325 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:33:58.866325 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: warnings.warn(msg) Dec 15 13:33:58.873930 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-c1776c0d-84f5-4191-8c77-feb31d7eb06c req-b1ba085e-5958-4338-9a19-b3c8d9250e83 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:58.874374 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-c1776c0d-84f5-4191-8c77-feb31d7eb06c req-b1ba085e-5958-4338-9a19-b3c8d9250e83 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:58.884787 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-c1776c0d-84f5-4191-8c77-feb31d7eb06c req-b1ba085e-5958-4338-9a19-b3c8d9250e83 service nova] Creating event network-vif-plugged:73028c18-6a30-4deb-9114-51244b03f4f4 for instance 638afde5-46d2-4df0-9d04-d24b9d7aee64 on hv-cinder-81322 Dec 15 13:33:58.889974 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-c1776c0d-84f5-4191-8c77-feb31d7eb06c req-b1ba085e-5958-4338-9a19-b3c8d9250e83 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028980 Dec 15 13:33:58.890584 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 242/494] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:33:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:33:59.129661 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-a07c84dd-a2d6-493f-953f-2103fd2bad2f tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:59.130482 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-a07c84dd-a2d6-493f-953f-2103fd2bad2f tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:59.133679 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-3d1f883b-d0bf-4144-b0ce-bd0ca212441f tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:33:59.134657 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-3d1f883b-d0bf-4144-b0ce-bd0ca212441f tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 638afde5-46d2-4df0-9d04-d24b9d7aee64] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:59.137623 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a07c84dd-a2d6-493f-953f-2103fd2bad2f tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:59.138132 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a07c84dd-a2d6-493f-953f-2103fd2bad2f tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:59.139529 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a07c84dd-a2d6-493f-953f-2103fd2bad2f tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:59.139982 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a07c84dd-a2d6-493f-953f-2103fd2bad2f tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:59.141804 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3d1f883b-d0bf-4144-b0ce-bd0ca212441f tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:59.142324 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3d1f883b-d0bf-4144-b0ce-bd0ca212441f tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:59.143219 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3d1f883b-d0bf-4144-b0ce-bd0ca212441f tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:59.143726 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3d1f883b-d0bf-4144-b0ce-bd0ca212441f tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:59.338011 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-3d1f883b-d0bf-4144-b0ce-bd0ca212441f tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:59.342357 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-a07c84dd-a2d6-493f-953f-2103fd2bad2f tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:33:59.346638 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-3d1f883b-d0bf-4144-b0ce-bd0ca212441f tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/638afde5-46d2-4df0-9d04-d24b9d7aee64" status: 200 len: 1318 microversion: 2.1 time: 0.217510 Dec 15 13:33:59.356125 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 243/495] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:59 2021] GET /compute/v2.1/servers/638afde5-46d2-4df0-9d04-d24b9d7aee64 => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:33:59.356301 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-a07c84dd-a2d6-493f-953f-2103fd2bad2f tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a" status: 200 len: 1567 microversion: 2.1 time: 0.224577 Dec 15 13:33:59.356301 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 253/496] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:33:59 2021] GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a => generated 1567 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:33:59.870755 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-d03bd5d4-f49d-4ab7-bf26-e8af53559a6b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:59.871708 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-d03bd5d4-f49d-4ab7-bf26-e8af53559a6b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:59.875625 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-66a990dc-44fe-4f4b-a7a0-f293f9d170e9 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:33:59.876526 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-66a990dc-44fe-4f4b-a7a0-f293f9d170e9 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:33:59.878496 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d03bd5d4-f49d-4ab7-bf26-e8af53559a6b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:59.878975 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d03bd5d4-f49d-4ab7-bf26-e8af53559a6b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:59.879761 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d03bd5d4-f49d-4ab7-bf26-e8af53559a6b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:59.880193 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d03bd5d4-f49d-4ab7-bf26-e8af53559a6b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:59.882599 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-66a990dc-44fe-4f4b-a7a0-f293f9d170e9 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:59.883186 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-66a990dc-44fe-4f4b-a7a0-f293f9d170e9 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:33:59.883981 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-66a990dc-44fe-4f4b-a7a0-f293f9d170e9 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:33:59.884418 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-66a990dc-44fe-4f4b-a7a0-f293f9d170e9 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:00.033105 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-d03bd5d4-f49d-4ab7-bf26-e8af53559a6b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 28625 microversion: 2.20 time: 0.165793 Dec 15 13:34:00.033794 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 244/497] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:33:59 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 28625 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:34:00.047334 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-66a990dc-44fe-4f4b-a7a0-f293f9d170e9 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 28660 microversion: 2.1 time: 0.175602 Dec 15 13:34:00.047984 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 254/498] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:33:59 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 28660 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:34:00.364219 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-c2d1f273-96c7-4e05-b453-c22ff1a21e57 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:00.365083 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-c2d1f273-96c7-4e05-b453-c22ff1a21e57 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 638afde5-46d2-4df0-9d04-d24b9d7aee64] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:00.368405 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-eb6127d8-4e23-4a05-827b-40f5efcb50a9 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:00.369116 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-eb6127d8-4e23-4a05-827b-40f5efcb50a9 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:00.371967 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c2d1f273-96c7-4e05-b453-c22ff1a21e57 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:00.373246 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c2d1f273-96c7-4e05-b453-c22ff1a21e57 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:00.374035 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c2d1f273-96c7-4e05-b453-c22ff1a21e57 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:00.374553 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c2d1f273-96c7-4e05-b453-c22ff1a21e57 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:00.376584 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-eb6127d8-4e23-4a05-827b-40f5efcb50a9 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:00.377045 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-eb6127d8-4e23-4a05-827b-40f5efcb50a9 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:00.377852 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-eb6127d8-4e23-4a05-827b-40f5efcb50a9 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:00.378498 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-eb6127d8-4e23-4a05-827b-40f5efcb50a9 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:00.577246 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-c2d1f273-96c7-4e05-b453-c22ff1a21e57 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:00.580599 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-eb6127d8-4e23-4a05-827b-40f5efcb50a9 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:00.586174 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-c2d1f273-96c7-4e05-b453-c22ff1a21e57 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/638afde5-46d2-4df0-9d04-d24b9d7aee64" status: 200 len: 1318 microversion: 2.1 time: 0.226074 Dec 15 13:34:00.587079 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 245/499] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:00 2021] GET /compute/v2.1/servers/638afde5-46d2-4df0-9d04-d24b9d7aee64 => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:34:00.589388 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-eb6127d8-4e23-4a05-827b-40f5efcb50a9 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a" status: 200 len: 1567 microversion: 2.1 time: 0.224890 Dec 15 13:34:00.589960 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 255/500] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:00 2021] GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a => generated 1567 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:34:01.044719 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-860b080b-188d-41ba-9b5f-45eb098a26d1 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:01.045632 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-860b080b-188d-41ba-9b5f-45eb098a26d1 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:01.051786 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-860b080b-188d-41ba-9b5f-45eb098a26d1 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:01.052231 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-860b080b-188d-41ba-9b5f-45eb098a26d1 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:01.053007 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-860b080b-188d-41ba-9b5f-45eb098a26d1 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:01.053523 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-860b080b-188d-41ba-9b5f-45eb098a26d1 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:01.058758 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ab5e9939-a8b5-4d0e-9c74-43b2c2103a40 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:01.059996 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ab5e9939-a8b5-4d0e-9c74-43b2c2103a40 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:01.066361 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ab5e9939-a8b5-4d0e-9c74-43b2c2103a40 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:01.067192 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ab5e9939-a8b5-4d0e-9c74-43b2c2103a40 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:01.068096 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ab5e9939-a8b5-4d0e-9c74-43b2c2103a40 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:01.068543 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ab5e9939-a8b5-4d0e-9c74-43b2c2103a40 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:01.143356 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ab5e9939-a8b5-4d0e-9c74-43b2c2103a40 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 28660 microversion: 2.1 time: 0.088109 Dec 15 13:34:01.144277 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 256/501] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:34:01 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 28660 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:34:01.146830 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-860b080b-188d-41ba-9b5f-45eb098a26d1 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 28625 microversion: 2.20 time: 0.105748 Dec 15 13:34:01.148296 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 246/502] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:34:01 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 28625 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:34:01.603411 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-fcc67e31-c96c-4455-943d-696813370fa0 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:01.604488 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-fcc67e31-c96c-4455-943d-696813370fa0 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 638afde5-46d2-4df0-9d04-d24b9d7aee64] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:01.606759 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-b30fd932-1f36-4111-a29a-8ce05e198c7a tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:01.607538 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-b30fd932-1f36-4111-a29a-8ce05e198c7a tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:01.612569 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-fcc67e31-c96c-4455-943d-696813370fa0 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:01.613036 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-fcc67e31-c96c-4455-943d-696813370fa0 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:01.613838 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-fcc67e31-c96c-4455-943d-696813370fa0 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:01.614280 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-fcc67e31-c96c-4455-943d-696813370fa0 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:01.614994 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b30fd932-1f36-4111-a29a-8ce05e198c7a tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:01.615459 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b30fd932-1f36-4111-a29a-8ce05e198c7a tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:01.619124 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b30fd932-1f36-4111-a29a-8ce05e198c7a tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:01.619769 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b30fd932-1f36-4111-a29a-8ce05e198c7a tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:01.826097 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-b30fd932-1f36-4111-a29a-8ce05e198c7a tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:01.830795 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-fcc67e31-c96c-4455-943d-696813370fa0 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:01.834622 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-b30fd932-1f36-4111-a29a-8ce05e198c7a tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a" status: 200 len: 1567 microversion: 2.1 time: 0.232030 Dec 15 13:34:01.835498 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 247/503] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:01 2021] GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a => generated 1567 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:34:01.838042 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-fcc67e31-c96c-4455-943d-696813370fa0 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/638afde5-46d2-4df0-9d04-d24b9d7aee64" status: 200 len: 1509 microversion: 2.1 time: 0.238658 Dec 15 13:34:01.838608 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 257/504] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:01 2021] GET /compute/v2.1/servers/638afde5-46d2-4df0-9d04-d24b9d7aee64 => generated 1509 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:34:02.154753 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-7c2c0b69-a0cc-4a46-b17e-ff81590ce4a5 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:02.155936 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-7c2c0b69-a0cc-4a46-b17e-ff81590ce4a5 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:02.158954 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-00f8655d-ad8d-437d-a1f7-dedf468d2acb tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:02.159873 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-00f8655d-ad8d-437d-a1f7-dedf468d2acb tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:02.162923 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7c2c0b69-a0cc-4a46-b17e-ff81590ce4a5 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:02.163453 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7c2c0b69-a0cc-4a46-b17e-ff81590ce4a5 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:02.164255 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7c2c0b69-a0cc-4a46-b17e-ff81590ce4a5 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:02.164780 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7c2c0b69-a0cc-4a46-b17e-ff81590ce4a5 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:02.165994 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-00f8655d-ad8d-437d-a1f7-dedf468d2acb tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:02.166447 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-00f8655d-ad8d-437d-a1f7-dedf468d2acb tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:02.167259 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-00f8655d-ad8d-437d-a1f7-dedf468d2acb tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:02.167700 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-00f8655d-ad8d-437d-a1f7-dedf468d2acb tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:02.237770 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-00f8655d-ad8d-437d-a1f7-dedf468d2acb tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 28625 microversion: 2.20 time: 0.082953 Dec 15 13:34:02.241778 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 258/505] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:34:02 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 28625 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:34:02.260909 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-7c2c0b69-a0cc-4a46-b17e-ff81590ce4a5 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 28660 microversion: 2.1 time: 0.109740 Dec 15 13:34:02.262478 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 248/506] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:34:02 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 28660 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:34:02.852391 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-2f9f4bd2-2340-47e6-b5bd-e8d694ac4d9f tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:02.853107 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-2f9f4bd2-2340-47e6-b5bd-e8d694ac4d9f tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:02.860573 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2f9f4bd2-2340-47e6-b5bd-e8d694ac4d9f tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:02.861040 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2f9f4bd2-2340-47e6-b5bd-e8d694ac4d9f tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:02.861839 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2f9f4bd2-2340-47e6-b5bd-e8d694ac4d9f tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:02.862288 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2f9f4bd2-2340-47e6-b5bd-e8d694ac4d9f tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:03.110825 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-2f9f4bd2-2340-47e6-b5bd-e8d694ac4d9f tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:03.119059 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-2f9f4bd2-2340-47e6-b5bd-e8d694ac4d9f tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a" status: 200 len: 1567 microversion: 2.1 time: 0.270994 Dec 15 13:34:03.119978 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 259/507] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:02 2021] GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a => generated 1567 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:34:03.165428 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-3501d0f2-e07c-4acc-ba32-19f4f0433db9 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "10bcd6be-7152-4578-a28c-e94c97dde175"}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:03.166648 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-3501d0f2-e07c-4acc-ba32-19f4f0433db9 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 638afde5-46d2-4df0-9d04-d24b9d7aee64] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:03.175089 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3501d0f2-e07c-4acc-ba32-19f4f0433db9 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:03.176061 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3501d0f2-e07c-4acc-ba32-19f4f0433db9 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:03.177151 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3501d0f2-e07c-4acc-ba32-19f4f0433db9 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:03.177599 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3501d0f2-e07c-4acc-ba32-19f4f0433db9 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:03.249188 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-065c04dd-f41d-4818-bd48-4ae1cb75c3db tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:03.251064 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-065c04dd-f41d-4818-bd48-4ae1cb75c3db tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:03.258116 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-065c04dd-f41d-4818-bd48-4ae1cb75c3db tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:03.258906 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-065c04dd-f41d-4818-bd48-4ae1cb75c3db tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:03.259942 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-065c04dd-f41d-4818-bd48-4ae1cb75c3db tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:03.261184 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-065c04dd-f41d-4818-bd48-4ae1cb75c3db tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:03.340551 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-065c04dd-f41d-4818-bd48-4ae1cb75c3db tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 28625 microversion: 2.20 time: 0.095007 Dec 15 13:34:03.341816 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 260/508] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:34:03 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 28625 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:34:03.351127 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-08227952-f9f3-4129-a5ee-6d9b452bee0a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:03.352363 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-08227952-f9f3-4129-a5ee-6d9b452bee0a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:03.359675 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-08227952-f9f3-4129-a5ee-6d9b452bee0a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:03.360376 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-08227952-f9f3-4129-a5ee-6d9b452bee0a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:03.361347 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-08227952-f9f3-4129-a5ee-6d9b452bee0a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:03.361792 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-08227952-f9f3-4129-a5ee-6d9b452bee0a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:03.433610 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-08227952-f9f3-4129-a5ee-6d9b452bee0a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 28660 microversion: 2.1 time: 0.086772 Dec 15 13:34:03.434389 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 261/509] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:34:03 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 28660 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:34:03.446276 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-3501d0f2-e07c-4acc-ba32-19f4f0433db9 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "POST /compute/v2.1/servers/638afde5-46d2-4df0-9d04-d24b9d7aee64/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.292337 Dec 15 13:34:03.446944 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 249/510] 10.222.0.60 () {60 vars in 1322 bytes} [Wed Dec 15 13:34:03 2021] POST /compute/v2.1/servers/638afde5-46d2-4df0-9d04-d24b9d7aee64/os-volume_attachments => generated 194 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:34:04.137529 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-8176aea4-b732-44ee-a23e-77c3054a5235 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:04.138752 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-8176aea4-b732-44ee-a23e-77c3054a5235 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:04.145618 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8176aea4-b732-44ee-a23e-77c3054a5235 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:04.146080 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8176aea4-b732-44ee-a23e-77c3054a5235 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:04.146896 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8176aea4-b732-44ee-a23e-77c3054a5235 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:04.147345 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8176aea4-b732-44ee-a23e-77c3054a5235 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:04.274938 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-8176aea4-b732-44ee-a23e-77c3054a5235 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:04.283631 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-8176aea4-b732-44ee-a23e-77c3054a5235 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a" status: 200 len: 1567 microversion: 2.1 time: 0.150112 Dec 15 13:34:04.284197 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 262/511] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:04 2021] GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:34:04.353585 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-102c2487-4726-4481-bfbf-97de5118e801 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:04.354636 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-102c2487-4726-4481-bfbf-97de5118e801 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:04.360708 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-102c2487-4726-4481-bfbf-97de5118e801 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:04.361161 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-102c2487-4726-4481-bfbf-97de5118e801 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:04.361940 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-102c2487-4726-4481-bfbf-97de5118e801 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:04.362384 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-102c2487-4726-4481-bfbf-97de5118e801 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:04.427179 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-102c2487-4726-4481-bfbf-97de5118e801 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 28625 microversion: 2.20 time: 0.077819 Dec 15 13:34:04.427737 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 250/512] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:34:04 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 28625 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:34:04.445260 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-d752a56c-1982-4f30-bf08-0269bae24d7a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:04.446450 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-d752a56c-1982-4f30-bf08-0269bae24d7a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:04.453349 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d752a56c-1982-4f30-bf08-0269bae24d7a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:04.453800 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d752a56c-1982-4f30-bf08-0269bae24d7a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:04.454574 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d752a56c-1982-4f30-bf08-0269bae24d7a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:04.455050 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d752a56c-1982-4f30-bf08-0269bae24d7a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:04.523731 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-d752a56c-1982-4f30-bf08-0269bae24d7a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 28660 microversion: 2.1 time: 0.081881 Dec 15 13:34:04.527663 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 263/513] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:34:04 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 28660 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:34:04.771786 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-f1413a00-6117-4033-959f-a0683ea6ff1a tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-450969085", "imageRef": "cfccedbb-7169-47ec-9bae-d4829cba54e1", "flavorRef": "452", "networks": [{"uuid": "4d3a2dfa-2632-456f-8365-44a5206de285"}]}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:04.822288 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.network.neutron [None req-f1413a00-6117-4033-959f-a0683ea6ff1a tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] validate_networks() for [('4d3a2dfa-2632-456f-8365-44a5206de285', None, None, None, None, None)] {{(pid=116941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:34:05.151807 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-f1413a00-6117-4033-959f-a0683ea6ff1a tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Flavor limits 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:34:05.152233 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-f1413a00-6117-4033-959f-a0683ea6ff1a tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Image limits 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:34:05.152705 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-f1413a00-6117-4033-959f-a0683ea6ff1a tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Flavor pref 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:34:05.153148 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-f1413a00-6117-4033-959f-a0683ea6ff1a tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Image pref 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:34:05.154060 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-f1413a00-6117-4033-959f-a0683ea6ff1a tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:34:05.162570 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f1413a00-6117-4033-959f-a0683ea6ff1a tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:05.163057 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f1413a00-6117-4033-959f-a0683ea6ff1a tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:05.163873 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f1413a00-6117-4033-959f-a0683ea6ff1a tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:05.164422 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f1413a00-6117-4033-959f-a0683ea6ff1a tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:05.181138 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-f1413a00-6117-4033-959f-a0683ea6ff1a tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Getting quotas for project 050149bd93864d2abd0b342b8062d3d5. Resources: {'cores', 'instances', 'ram'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:34:05.184966 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-f1413a00-6117-4033-959f-a0683ea6ff1a tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Getting quotas for user a52a2c8071134b07bdc222088246a671 and project 050149bd93864d2abd0b342b8062d3d5. Resources: {'cores', 'instances', 'ram'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:34:05.195700 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-f1413a00-6117-4033-959f-a0683ea6ff1a tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Going to run 1 instances... {{(pid=116941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:34:05.198389 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-f1413a00-6117-4033-959f-a0683ea6ff1a tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] [instance: 9dc28a7e-3433-4b18-b45e-9818080b2f7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cfccedbb-7169-47ec-9bae-d4829cba54e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:34:05.247841 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-f1413a00-6117-4033-959f-a0683ea6ff1a tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.479897 Dec 15 13:34:05.248496 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 251/514] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Dec 15 13:34:04 2021] POST /compute/v2.1/servers => generated 380 bytes in 481 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 13:34:05.258518 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-bb1bba3e-9b96-427b-a013-545660724c03 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:05.259245 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-bb1bba3e-9b96-427b-a013-545660724c03 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] [instance: 9dc28a7e-3433-4b18-b45e-9818080b2f7b] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:05.300379 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-f7eff45a-b822-4057-a78d-dee28b879827 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:05.300990 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-f7eff45a-b822-4057-a78d-dee28b879827 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:05.307799 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f7eff45a-b822-4057-a78d-dee28b879827 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:05.308251 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f7eff45a-b822-4057-a78d-dee28b879827 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:05.309037 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f7eff45a-b822-4057-a78d-dee28b879827 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:05.310226 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f7eff45a-b822-4057-a78d-dee28b879827 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:05.315604 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-bb1bba3e-9b96-427b-a013-545660724c03 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52a2c8071134b07bdc222088246a671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050149bd93864d2abd0b342b8062d3d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:05.322295 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-bb1bba3e-9b96-427b-a013-545660724c03 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] 10.222.0.60 "GET /compute/v2.1/servers/9dc28a7e-3433-4b18-b45e-9818080b2f7b" status: 200 len: 1213 microversion: 2.1 time: 0.067654 Dec 15 13:34:05.323260 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 264/515] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:05 2021] GET /compute/v2.1/servers/9dc28a7e-3433-4b18-b45e-9818080b2f7b => generated 1213 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:34:05.438988 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-b9790f3c-2ffa-43a5-a510-fc550d7838b7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:05.440035 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-b9790f3c-2ffa-43a5-a510-fc550d7838b7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:05.446711 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b9790f3c-2ffa-43a5-a510-fc550d7838b7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:05.447850 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b9790f3c-2ffa-43a5-a510-fc550d7838b7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:05.448707 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b9790f3c-2ffa-43a5-a510-fc550d7838b7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:05.449099 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b9790f3c-2ffa-43a5-a510-fc550d7838b7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:05.450896 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-f7eff45a-b822-4057-a78d-dee28b879827 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:05.460105 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-f7eff45a-b822-4057-a78d-dee28b879827 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a" status: 200 len: 1567 microversion: 2.1 time: 0.163275 Dec 15 13:34:05.460649 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 252/516] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:05 2021] GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:34:05.519835 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-b9790f3c-2ffa-43a5-a510-fc550d7838b7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 28625 microversion: 2.20 time: 0.085016 Dec 15 13:34:05.524615 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 265/517] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:34:05 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 28625 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:34:05.535404 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-15c7ce89-d834-4dc9-a399-0a5517a8635d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:05.536399 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-15c7ce89-d834-4dc9-a399-0a5517a8635d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:05.542212 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-15c7ce89-d834-4dc9-a399-0a5517a8635d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:05.542665 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-15c7ce89-d834-4dc9-a399-0a5517a8635d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:05.543569 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-15c7ce89-d834-4dc9-a399-0a5517a8635d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:05.544395 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-15c7ce89-d834-4dc9-a399-0a5517a8635d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:05.615898 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-15c7ce89-d834-4dc9-a399-0a5517a8635d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 28660 microversion: 2.1 time: 0.083908 Dec 15 13:34:05.616889 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 253/518] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:34:05 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 28660 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:34:06.340719 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ce64f483-cf34-4935-8c97-47450c13e3a2 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:06.342018 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ce64f483-cf34-4935-8c97-47450c13e3a2 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] [instance: 9dc28a7e-3433-4b18-b45e-9818080b2f7b] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:06.348870 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ce64f483-cf34-4935-8c97-47450c13e3a2 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:06.349339 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ce64f483-cf34-4935-8c97-47450c13e3a2 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:06.350149 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ce64f483-cf34-4935-8c97-47450c13e3a2 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:06.350568 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ce64f483-cf34-4935-8c97-47450c13e3a2 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:06.417501 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-ce64f483-cf34-4935-8c97-47450c13e3a2 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52a2c8071134b07bdc222088246a671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050149bd93864d2abd0b342b8062d3d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:06.425355 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ce64f483-cf34-4935-8c97-47450c13e3a2 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] 10.222.0.60 "GET /compute/v2.1/servers/9dc28a7e-3433-4b18-b45e-9818080b2f7b" status: 200 len: 1271 microversion: 2.1 time: 0.089026 Dec 15 13:34:06.426049 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 266/519] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:06 2021] GET /compute/v2.1/servers/9dc28a7e-3433-4b18-b45e-9818080b2f7b => generated 1271 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:34:06.477544 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-cb858738-c627-4338-9153-8fd676b46859 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:06.478244 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-cb858738-c627-4338-9153-8fd676b46859 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:06.485043 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cb858738-c627-4338-9153-8fd676b46859 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:06.485488 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cb858738-c627-4338-9153-8fd676b46859 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:06.486414 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cb858738-c627-4338-9153-8fd676b46859 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:06.486873 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cb858738-c627-4338-9153-8fd676b46859 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:06.532816 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-24e684ba-3b0c-41f4-b8d3-100b13c94301 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:06.534023 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-24e684ba-3b0c-41f4-b8d3-100b13c94301 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:06.540633 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-24e684ba-3b0c-41f4-b8d3-100b13c94301 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:06.541307 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-24e684ba-3b0c-41f4-b8d3-100b13c94301 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:06.542257 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-24e684ba-3b0c-41f4-b8d3-100b13c94301 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:06.542880 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-24e684ba-3b0c-41f4-b8d3-100b13c94301 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:06.620654 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-cb858738-c627-4338-9153-8fd676b46859 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:06.634540 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-cb858738-c627-4338-9153-8fd676b46859 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a" status: 200 len: 1567 microversion: 2.1 time: 0.160966 Dec 15 13:34:06.635191 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 254/520] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:06 2021] GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:34:06.641315 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-98fc700a-b360-4c35-9ad4-9a7c06e62aaa tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:06.641712 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-24e684ba-3b0c-41f4-b8d3-100b13c94301 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 28625 microversion: 2.20 time: 0.111415 Dec 15 13:34:06.642601 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-98fc700a-b360-4c35-9ad4-9a7c06e62aaa tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:06.646907 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 267/521] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:34:06 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 28625 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:34:06.651243 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-98fc700a-b360-4c35-9ad4-9a7c06e62aaa tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:06.651695 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-98fc700a-b360-4c35-9ad4-9a7c06e62aaa tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:06.660205 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-98fc700a-b360-4c35-9ad4-9a7c06e62aaa tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:06.661035 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-98fc700a-b360-4c35-9ad4-9a7c06e62aaa tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:06.734112 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-98fc700a-b360-4c35-9ad4-9a7c06e62aaa tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 28660 microversion: 2.1 time: 0.097137 Dec 15 13:34:06.737977 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 255/522] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:34:06 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 28660 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:34:07.441661 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-8d0258cb-c032-480f-8e22-567d263d4a4f req-dc93dbef-a520-43df-a4b5-334c0bc82229 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dc28a7e-3433-4b18-b45e-9818080b2f7b", "tag": "d9f33076-1c2e-4ce1-822b-f66e969079f6"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:07.442604 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-5c11e826-a85c-420e-8f45-0e0b7d1cd8db tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:07.443659 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:34:07.443659 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: warnings.warn(msg) Dec 15 13:34:07.443852 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-5c11e826-a85c-420e-8f45-0e0b7d1cd8db tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] [instance: 9dc28a7e-3433-4b18-b45e-9818080b2f7b] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:07.452395 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5c11e826-a85c-420e-8f45-0e0b7d1cd8db tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:07.452932 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5c11e826-a85c-420e-8f45-0e0b7d1cd8db tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:07.453826 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5c11e826-a85c-420e-8f45-0e0b7d1cd8db tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:07.456137 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-8d0258cb-c032-480f-8e22-567d263d4a4f req-dc93dbef-a520-43df-a4b5-334c0bc82229 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:07.456691 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-8d0258cb-c032-480f-8e22-567d263d4a4f req-dc93dbef-a520-43df-a4b5-334c0bc82229 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:07.462120 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5c11e826-a85c-420e-8f45-0e0b7d1cd8db tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:07.471078 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-8d0258cb-c032-480f-8e22-567d263d4a4f req-dc93dbef-a520-43df-a4b5-334c0bc82229 service nova] Creating event network-changed:d9f33076-1c2e-4ce1-822b-f66e969079f6 for instance 9dc28a7e-3433-4b18-b45e-9818080b2f7b on hv-cinder-81322 Dec 15 13:34:07.475779 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-8d0258cb-c032-480f-8e22-567d263d4a4f req-dc93dbef-a520-43df-a4b5-334c0bc82229 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041158 Dec 15 13:34:07.476462 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 268/523] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:34:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:34:07.599113 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-5c11e826-a85c-420e-8f45-0e0b7d1cd8db tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52a2c8071134b07bdc222088246a671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050149bd93864d2abd0b342b8062d3d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:07.606426 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-5c11e826-a85c-420e-8f45-0e0b7d1cd8db tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] 10.222.0.60 "GET /compute/v2.1/servers/9dc28a7e-3433-4b18-b45e-9818080b2f7b" status: 200 len: 1313 microversion: 2.1 time: 0.168437 Dec 15 13:34:07.607021 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 256/524] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:07 2021] GET /compute/v2.1/servers/9dc28a7e-3433-4b18-b45e-9818080b2f7b => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:34:07.657519 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-81dd9b2c-20e9-4632-88fd-fbfb2018f614 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:07.658645 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-81dd9b2c-20e9-4632-88fd-fbfb2018f614 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:07.660763 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-fad0f3ab-5faa-4919-8857-6522f01367bc tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:07.662113 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-fad0f3ab-5faa-4919-8857-6522f01367bc tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:07.666880 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-81dd9b2c-20e9-4632-88fd-fbfb2018f614 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:07.667742 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-81dd9b2c-20e9-4632-88fd-fbfb2018f614 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:07.668710 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-fad0f3ab-5faa-4919-8857-6522f01367bc tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:07.669042 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-81dd9b2c-20e9-4632-88fd-fbfb2018f614 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:07.669284 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-fad0f3ab-5faa-4919-8857-6522f01367bc tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:07.669866 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-81dd9b2c-20e9-4632-88fd-fbfb2018f614 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:07.670667 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-fad0f3ab-5faa-4919-8857-6522f01367bc tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:07.671131 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-fad0f3ab-5faa-4919-8857-6522f01367bc tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:07.752515 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-fad0f3ab-5faa-4919-8857-6522f01367bc tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 28625 microversion: 2.20 time: 0.098380 Dec 15 13:34:07.753166 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 257/525] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:34:07 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 28625 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:34:07.758324 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-a878f5cb-6bc7-495c-9eb7-6392de581cf5 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:07.759357 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-a878f5cb-6bc7-495c-9eb7-6392de581cf5 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:07.766338 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a878f5cb-6bc7-495c-9eb7-6392de581cf5 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:07.766796 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a878f5cb-6bc7-495c-9eb7-6392de581cf5 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:07.767814 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a878f5cb-6bc7-495c-9eb7-6392de581cf5 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:07.768260 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a878f5cb-6bc7-495c-9eb7-6392de581cf5 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:07.822761 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-81dd9b2c-20e9-4632-88fd-fbfb2018f614 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:07.830595 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-81dd9b2c-20e9-4632-88fd-fbfb2018f614 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a" status: 200 len: 1567 microversion: 2.1 time: 0.181855 Dec 15 13:34:07.831427 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 269/526] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:07 2021] GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:34:07.871270 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-a878f5cb-6bc7-495c-9eb7-6392de581cf5 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 28660 microversion: 2.1 time: 0.116513 Dec 15 13:34:07.876006 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 258/527] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:34:07 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 28660 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:34:08.623250 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-a76ada1a-bea2-48d1-bb7a-d1d908d2e46d tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:08.623858 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-a76ada1a-bea2-48d1-bb7a-d1d908d2e46d tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] [instance: 9dc28a7e-3433-4b18-b45e-9818080b2f7b] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:08.630222 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a76ada1a-bea2-48d1-bb7a-d1d908d2e46d tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:08.630671 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a76ada1a-bea2-48d1-bb7a-d1d908d2e46d tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:08.631486 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a76ada1a-bea2-48d1-bb7a-d1d908d2e46d tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:08.631920 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a76ada1a-bea2-48d1-bb7a-d1d908d2e46d tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:08.765895 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-a530cf36-1b79-485e-8209-9bcfee1e6391 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:08.767520 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-a530cf36-1b79-485e-8209-9bcfee1e6391 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:08.774537 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a530cf36-1b79-485e-8209-9bcfee1e6391 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:08.775269 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a530cf36-1b79-485e-8209-9bcfee1e6391 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:08.776215 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a530cf36-1b79-485e-8209-9bcfee1e6391 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:08.776821 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a530cf36-1b79-485e-8209-9bcfee1e6391 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:08.860103 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-a530cf36-1b79-485e-8209-9bcfee1e6391 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 28625 microversion: 2.20 time: 0.098608 Dec 15 13:34:08.860961 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 259/528] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:34:08 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 28625 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:34:08.866299 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-01a28643-9c6a-4e51-9e2b-dcef5e159722 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:08.867406 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-01a28643-9c6a-4e51-9e2b-dcef5e159722 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:08.875477 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-01a28643-9c6a-4e51-9e2b-dcef5e159722 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:08.875845 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-01a28643-9c6a-4e51-9e2b-dcef5e159722 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:08.876802 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-01a28643-9c6a-4e51-9e2b-dcef5e159722 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:08.877418 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-01a28643-9c6a-4e51-9e2b-dcef5e159722 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:08.983268 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-a76ada1a-bea2-48d1-bb7a-d1d908d2e46d tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52a2c8071134b07bdc222088246a671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050149bd93864d2abd0b342b8062d3d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:08.990445 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-a76ada1a-bea2-48d1-bb7a-d1d908d2e46d tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] 10.222.0.60 "GET /compute/v2.1/servers/9dc28a7e-3433-4b18-b45e-9818080b2f7b" status: 200 len: 1313 microversion: 2.1 time: 0.370846 Dec 15 13:34:08.991040 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 270/529] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:08 2021] GET /compute/v2.1/servers/9dc28a7e-3433-4b18-b45e-9818080b2f7b => generated 1313 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:34:09.000511 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-992ad19a-4867-4028-a804-cb6aaf0cd949 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:09.001500 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-992ad19a-4867-4028-a804-cb6aaf0cd949 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:09.007478 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-992ad19a-4867-4028-a804-cb6aaf0cd949 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:09.007880 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-992ad19a-4867-4028-a804-cb6aaf0cd949 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:09.008674 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-992ad19a-4867-4028-a804-cb6aaf0cd949 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:09.009125 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-992ad19a-4867-4028-a804-cb6aaf0cd949 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:09.042777 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-01a28643-9c6a-4e51-9e2b-dcef5e159722 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:09.050594 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-01a28643-9c6a-4e51-9e2b-dcef5e159722 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a" status: 200 len: 1567 microversion: 2.1 time: 0.188184 Dec 15 13:34:09.051226 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 260/530] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:08 2021] GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a => generated 1567 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:34:09.117745 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-992ad19a-4867-4028-a804-cb6aaf0cd949 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 28660 microversion: 2.1 time: 0.120983 Dec 15 13:34:09.121595 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 271/531] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:34:08 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 28660 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:34:09.872618 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-86b5ac8a-68b4-4585-840e-f913e54bd75e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:09.873529 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-86b5ac8a-68b4-4585-840e-f913e54bd75e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:09.879740 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-86b5ac8a-68b4-4585-840e-f913e54bd75e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:09.880187 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-86b5ac8a-68b4-4585-840e-f913e54bd75e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:09.881040 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-86b5ac8a-68b4-4585-840e-f913e54bd75e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:09.881479 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-86b5ac8a-68b4-4585-840e-f913e54bd75e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:10.006483 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-86b5ac8a-68b4-4585-840e-f913e54bd75e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 28625 microversion: 2.20 time: 0.137465 Dec 15 13:34:10.010575 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 261/532] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:34:09 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 28625 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:34:10.010720 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-5823b4ad-25d4-4488-b66c-78c986bc4a4c tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:10.010720 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-5823b4ad-25d4-4488-b66c-78c986bc4a4c tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] [instance: 9dc28a7e-3433-4b18-b45e-9818080b2f7b] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:10.016080 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5823b4ad-25d4-4488-b66c-78c986bc4a4c tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:10.016529 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5823b4ad-25d4-4488-b66c-78c986bc4a4c tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:10.017306 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5823b4ad-25d4-4488-b66c-78c986bc4a4c tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:10.017764 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5823b4ad-25d4-4488-b66c-78c986bc4a4c tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:10.068600 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-eeaee02a-6e37-453f-94d0-db721d6035db tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:10.069302 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-eeaee02a-6e37-453f-94d0-db721d6035db tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:10.076961 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-eeaee02a-6e37-453f-94d0-db721d6035db tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:10.077413 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-eeaee02a-6e37-453f-94d0-db721d6035db tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:10.078206 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-eeaee02a-6e37-453f-94d0-db721d6035db tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:10.078650 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-eeaee02a-6e37-453f-94d0-db721d6035db tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:10.180307 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-5823b4ad-25d4-4488-b66c-78c986bc4a4c tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52a2c8071134b07bdc222088246a671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050149bd93864d2abd0b342b8062d3d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:10.187856 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-5823b4ad-25d4-4488-b66c-78c986bc4a4c tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] 10.222.0.60 "GET /compute/v2.1/servers/9dc28a7e-3433-4b18-b45e-9818080b2f7b" status: 200 len: 1313 microversion: 2.1 time: 0.183832 Dec 15 13:34:10.188570 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 272/533] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:10 2021] GET /compute/v2.1/servers/9dc28a7e-3433-4b18-b45e-9818080b2f7b => generated 1313 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:34:10.192942 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-59501dde-00e3-410a-9aab-538bac6147d8 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:10.193839 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-59501dde-00e3-410a-9aab-538bac6147d8 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:10.201130 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-59501dde-00e3-410a-9aab-538bac6147d8 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:10.201574 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-59501dde-00e3-410a-9aab-538bac6147d8 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:10.202355 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-59501dde-00e3-410a-9aab-538bac6147d8 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:10.202792 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-59501dde-00e3-410a-9aab-538bac6147d8 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:10.242389 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-eeaee02a-6e37-453f-94d0-db721d6035db tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:10.250221 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-eeaee02a-6e37-453f-94d0-db721d6035db tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a" status: 200 len: 1567 microversion: 2.1 time: 0.185636 Dec 15 13:34:10.250790 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 262/534] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:10 2021] GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a => generated 1567 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:34:10.283278 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-59501dde-00e3-410a-9aab-538bac6147d8 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 28660 microversion: 2.1 time: 0.093263 Dec 15 13:34:10.283875 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 273/535] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:34:10 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 28660 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:34:11.018909 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-19277b34-ddb9-4be8-a77c-0a4a15ff95f6 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:11.019854 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-19277b34-ddb9-4be8-a77c-0a4a15ff95f6 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:11.026183 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-19277b34-ddb9-4be8-a77c-0a4a15ff95f6 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:11.026640 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-19277b34-ddb9-4be8-a77c-0a4a15ff95f6 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:11.027455 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-19277b34-ddb9-4be8-a77c-0a4a15ff95f6 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:11.027893 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-19277b34-ddb9-4be8-a77c-0a4a15ff95f6 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:11.155731 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-19277b34-ddb9-4be8-a77c-0a4a15ff95f6 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 28787 microversion: 2.20 time: 0.140412 Dec 15 13:34:11.156393 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 263/536] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:34:11 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 28787 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:34:11.208733 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-b70d8acb-66c8-4c61-9ea5-3bd0f39c196d tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:11.210660 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-b70d8acb-66c8-4c61-9ea5-3bd0f39c196d tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] [instance: 9dc28a7e-3433-4b18-b45e-9818080b2f7b] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:11.219941 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b70d8acb-66c8-4c61-9ea5-3bd0f39c196d tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:11.220663 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b70d8acb-66c8-4c61-9ea5-3bd0f39c196d tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:11.221955 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b70d8acb-66c8-4c61-9ea5-3bd0f39c196d tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:11.222769 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b70d8acb-66c8-4c61-9ea5-3bd0f39c196d tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:11.267352 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-f20abb71-7075-40e2-b7af-4534936c6acc tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:11.268075 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-f20abb71-7075-40e2-b7af-4534936c6acc tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:11.275848 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f20abb71-7075-40e2-b7af-4534936c6acc tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:11.276300 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f20abb71-7075-40e2-b7af-4534936c6acc tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:11.277102 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f20abb71-7075-40e2-b7af-4534936c6acc tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:11.277552 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f20abb71-7075-40e2-b7af-4534936c6acc tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:11.467120 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-b70d8acb-66c8-4c61-9ea5-3bd0f39c196d tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52a2c8071134b07bdc222088246a671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050149bd93864d2abd0b342b8062d3d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:11.474454 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-b70d8acb-66c8-4c61-9ea5-3bd0f39c196d tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] 10.222.0.60 "GET /compute/v2.1/servers/9dc28a7e-3433-4b18-b45e-9818080b2f7b" status: 200 len: 1313 microversion: 2.1 time: 0.272629 Dec 15 13:34:11.475135 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 274/537] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:11 2021] GET /compute/v2.1/servers/9dc28a7e-3433-4b18-b45e-9818080b2f7b => generated 1313 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:34:11.479473 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-d44b1823-1ea3-4d2a-aa03-af8b0ae5c7ce tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:11.480450 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-d44b1823-1ea3-4d2a-aa03-af8b0ae5c7ce tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:11.487082 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d44b1823-1ea3-4d2a-aa03-af8b0ae5c7ce tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:11.487540 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d44b1823-1ea3-4d2a-aa03-af8b0ae5c7ce tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:11.488320 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d44b1823-1ea3-4d2a-aa03-af8b0ae5c7ce tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:11.488752 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d44b1823-1ea3-4d2a-aa03-af8b0ae5c7ce tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:11.519417 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-f20abb71-7075-40e2-b7af-4534936c6acc tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:11.527334 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-f20abb71-7075-40e2-b7af-4534936c6acc tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a" status: 200 len: 1567 microversion: 2.1 time: 0.263887 Dec 15 13:34:11.527936 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 264/538] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:11 2021] GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a => generated 1567 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:34:11.566235 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-d44b1823-1ea3-4d2a-aa03-af8b0ae5c7ce tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 28660 microversion: 2.1 time: 0.089805 Dec 15 13:34:11.566919 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 275/539] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:34:11 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 28660 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:34:12.115692 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-39f82c24-0447-4f6b-9851-c17204664e44 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:12.116187 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-39f82c24-0447-4f6b-9851-c17204664e44 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 638afde5-46d2-4df0-9d04-d24b9d7aee64] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:12.122445 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-39f82c24-0447-4f6b-9851-c17204664e44 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:12.122943 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-39f82c24-0447-4f6b-9851-c17204664e44 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:12.123723 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-39f82c24-0447-4f6b-9851-c17204664e44 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:12.124157 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-39f82c24-0447-4f6b-9851-c17204664e44 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:12.166816 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-cd01fe14-9bb5-4cb3-afbc-c3744ca16f6c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:12.167839 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-cd01fe14-9bb5-4cb3-afbc-c3744ca16f6c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:12.174661 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-cd01fe14-9bb5-4cb3-afbc-c3744ca16f6c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:12.175148 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-cd01fe14-9bb5-4cb3-afbc-c3744ca16f6c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:12.175971 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-cd01fe14-9bb5-4cb3-afbc-c3744ca16f6c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:12.176412 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-cd01fe14-9bb5-4cb3-afbc-c3744ca16f6c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:12.200571 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.objects.instance [None req-39f82c24-0447-4f6b-9851-c17204664e44 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lazy-loading 'services' on Instance uuid 638afde5-46d2-4df0-9d04-d24b9d7aee64 {{(pid=116941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:34:12.267266 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-cd01fe14-9bb5-4cb3-afbc-c3744ca16f6c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 30050 microversion: 2.20 time: 0.104215 Dec 15 13:34:12.271273 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 276/540] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:34:12 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 30050 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:34:12.271438 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-39f82c24-0447-4f6b-9851-c17204664e44 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "DELETE /compute/v2.1/servers/638afde5-46d2-4df0-9d04-d24b9d7aee64/os-volume_attachments/10bcd6be-7152-4578-a28c-e94c97dde175" status: 202 len: 0 microversion: 2.1 time: 0.156807 Dec 15 13:34:12.271438 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 265/541] 10.222.0.60 () {58 vars in 1415 bytes} [Wed Dec 15 13:34:12 2021] DELETE /compute/v2.1/servers/638afde5-46d2-4df0-9d04-d24b9d7aee64/os-volume_attachments/10bcd6be-7152-4578-a28c-e94c97dde175 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:34:12.278678 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-b68391b4-d36e-41a6-ba5e-692ef4b971f4 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:12.279729 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-b68391b4-d36e-41a6-ba5e-692ef4b971f4 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 638afde5-46d2-4df0-9d04-d24b9d7aee64] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:12.286479 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b68391b4-d36e-41a6-ba5e-692ef4b971f4 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:12.286966 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b68391b4-d36e-41a6-ba5e-692ef4b971f4 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:12.287791 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b68391b4-d36e-41a6-ba5e-692ef4b971f4 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:12.288219 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b68391b4-d36e-41a6-ba5e-692ef4b971f4 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:12.318662 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-b68391b4-d36e-41a6-ba5e-692ef4b971f4 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/638afde5-46d2-4df0-9d04-d24b9d7aee64/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044594 Dec 15 13:34:12.319248 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 277/542] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Dec 15 13:34:12 2021] GET /compute/v2.1/servers/638afde5-46d2-4df0-9d04-d24b9d7aee64/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:34:12.492111 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-82169717-9c0d-4723-afcc-935f238c8c75 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:12.492832 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-82169717-9c0d-4723-afcc-935f238c8c75 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] [instance: 9dc28a7e-3433-4b18-b45e-9818080b2f7b] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:12.499803 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-82169717-9c0d-4723-afcc-935f238c8c75 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:12.500247 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-82169717-9c0d-4723-afcc-935f238c8c75 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:12.501022 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-82169717-9c0d-4723-afcc-935f238c8c75 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:12.501454 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-82169717-9c0d-4723-afcc-935f238c8c75 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:12.543214 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-8266c9bf-4806-4c7a-a3d7-78b2b65b189e tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:12.543979 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-8266c9bf-4806-4c7a-a3d7-78b2b65b189e tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:12.550026 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8266c9bf-4806-4c7a-a3d7-78b2b65b189e tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:12.550457 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8266c9bf-4806-4c7a-a3d7-78b2b65b189e tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:12.551267 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8266c9bf-4806-4c7a-a3d7-78b2b65b189e tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:12.551704 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8266c9bf-4806-4c7a-a3d7-78b2b65b189e tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:12.657485 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-82169717-9c0d-4723-afcc-935f238c8c75 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52a2c8071134b07bdc222088246a671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050149bd93864d2abd0b342b8062d3d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:12.665016 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-82169717-9c0d-4723-afcc-935f238c8c75 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] 10.222.0.60 "GET /compute/v2.1/servers/9dc28a7e-3433-4b18-b45e-9818080b2f7b" status: 200 len: 1313 microversion: 2.1 time: 0.176917 Dec 15 13:34:12.665604 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 266/543] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:12 2021] GET /compute/v2.1/servers/9dc28a7e-3433-4b18-b45e-9818080b2f7b => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:34:12.670650 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-a3f22563-8998-41cc-83d4-a20e33729d8c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:12.671638 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-a3f22563-8998-41cc-83d4-a20e33729d8c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:12.677587 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a3f22563-8998-41cc-83d4-a20e33729d8c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:12.678033 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a3f22563-8998-41cc-83d4-a20e33729d8c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:12.678815 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a3f22563-8998-41cc-83d4-a20e33729d8c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:12.679310 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a3f22563-8998-41cc-83d4-a20e33729d8c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:12.719889 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-8266c9bf-4806-4c7a-a3d7-78b2b65b189e tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:12.727807 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-8266c9bf-4806-4c7a-a3d7-78b2b65b189e tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a" status: 200 len: 1567 microversion: 2.1 time: 0.188218 Dec 15 13:34:12.728379 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 278/544] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:12 2021] GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a => generated 1567 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:34:12.851362 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-a3f22563-8998-41cc-83d4-a20e33729d8c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 28660 microversion: 2.1 time: 0.184464 Dec 15 13:34:12.855168 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 267/545] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:34:12 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 28660 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:34:13.279360 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-bb8c8cc0-0706-490b-bb4c-a624f608d10e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:13.280264 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-bb8c8cc0-0706-490b-bb4c-a624f608d10e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:13.286355 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-bb8c8cc0-0706-490b-bb4c-a624f608d10e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:13.286805 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-bb8c8cc0-0706-490b-bb4c-a624f608d10e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:13.287608 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-bb8c8cc0-0706-490b-bb4c-a624f608d10e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:13.288040 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-bb8c8cc0-0706-490b-bb4c-a624f608d10e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:13.331658 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-7aaa5be3-d352-47ae-8e78-5b2b33b0eea0 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:13.332649 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-7aaa5be3-d352-47ae-8e78-5b2b33b0eea0 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 638afde5-46d2-4df0-9d04-d24b9d7aee64] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:13.339781 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7aaa5be3-d352-47ae-8e78-5b2b33b0eea0 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:13.340236 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7aaa5be3-d352-47ae-8e78-5b2b33b0eea0 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:13.341053 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7aaa5be3-d352-47ae-8e78-5b2b33b0eea0 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:13.341539 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7aaa5be3-d352-47ae-8e78-5b2b33b0eea0 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:13.372132 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-7aaa5be3-d352-47ae-8e78-5b2b33b0eea0 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/638afde5-46d2-4df0-9d04-d24b9d7aee64/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044003 Dec 15 13:34:13.372695 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 268/546] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Dec 15 13:34:13 2021] GET /compute/v2.1/servers/638afde5-46d2-4df0-9d04-d24b9d7aee64/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:34:13.409171 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-bb8c8cc0-0706-490b-bb4c-a624f608d10e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 31067 microversion: 2.20 time: 0.133837 Dec 15 13:34:13.410020 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 279/547] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:34:13 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 31067 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:34:13.681217 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-780a496c-05d2-4863-a592-b242e81a16ef tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:13.681819 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-780a496c-05d2-4863-a592-b242e81a16ef tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] [instance: 9dc28a7e-3433-4b18-b45e-9818080b2f7b] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:13.688784 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-780a496c-05d2-4863-a592-b242e81a16ef tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:13.689235 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-780a496c-05d2-4863-a592-b242e81a16ef tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:13.690024 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-780a496c-05d2-4863-a592-b242e81a16ef tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:13.690525 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-780a496c-05d2-4863-a592-b242e81a16ef tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:13.749343 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-9b966359-6e46-4915-8128-740c5cdd83a7 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:13.750062 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-9b966359-6e46-4915-8128-740c5cdd83a7 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:13.756860 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9b966359-6e46-4915-8128-740c5cdd83a7 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:13.757321 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9b966359-6e46-4915-8128-740c5cdd83a7 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:13.758120 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9b966359-6e46-4915-8128-740c5cdd83a7 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:13.758566 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9b966359-6e46-4915-8128-740c5cdd83a7 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:13.843625 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-780a496c-05d2-4863-a592-b242e81a16ef tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52a2c8071134b07bdc222088246a671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050149bd93864d2abd0b342b8062d3d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:13.851012 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-780a496c-05d2-4863-a592-b242e81a16ef tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] 10.222.0.60 "GET /compute/v2.1/servers/9dc28a7e-3433-4b18-b45e-9818080b2f7b" status: 200 len: 1313 microversion: 2.1 time: 0.173433 Dec 15 13:34:13.851591 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 269/548] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:13 2021] GET /compute/v2.1/servers/9dc28a7e-3433-4b18-b45e-9818080b2f7b => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:34:13.863353 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-8a1b2c1a-fc45-4e8d-86f1-da3efcfc81e6 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:13.864357 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-8a1b2c1a-fc45-4e8d-86f1-da3efcfc81e6 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:13.870318 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8a1b2c1a-fc45-4e8d-86f1-da3efcfc81e6 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:13.870880 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8a1b2c1a-fc45-4e8d-86f1-da3efcfc81e6 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:13.871788 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8a1b2c1a-fc45-4e8d-86f1-da3efcfc81e6 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:13.872228 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8a1b2c1a-fc45-4e8d-86f1-da3efcfc81e6 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:13.911518 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-9b966359-6e46-4915-8128-740c5cdd83a7 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:13.919919 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-9b966359-6e46-4915-8128-740c5cdd83a7 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a" status: 200 len: 1567 microversion: 2.1 time: 0.175153 Dec 15 13:34:13.920500 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 280/549] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:13 2021] GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:34:13.969107 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-8a1b2c1a-fc45-4e8d-86f1-da3efcfc81e6 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 29207 microversion: 2.1 time: 0.109225 Dec 15 13:34:13.969757 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 270/550] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:34:13 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 29207 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:34:14.383613 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-a75febbc-597d-4496-9d27-0d791902661c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:14.384835 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-a75febbc-597d-4496-9d27-0d791902661c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 638afde5-46d2-4df0-9d04-d24b9d7aee64] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:14.391909 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a75febbc-597d-4496-9d27-0d791902661c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:14.392358 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a75febbc-597d-4496-9d27-0d791902661c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:14.393134 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a75febbc-597d-4496-9d27-0d791902661c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:14.393567 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a75febbc-597d-4496-9d27-0d791902661c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:14.421612 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-c7309025-af0c-4b98-ad58-89cba1dbe52b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:14.422643 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-c7309025-af0c-4b98-ad58-89cba1dbe52b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:14.422957 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-a75febbc-597d-4496-9d27-0d791902661c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/638afde5-46d2-4df0-9d04-d24b9d7aee64/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043118 Dec 15 13:34:14.423520 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 281/551] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Dec 15 13:34:14 2021] GET /compute/v2.1/servers/638afde5-46d2-4df0-9d04-d24b9d7aee64/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:34:14.429305 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c7309025-af0c-4b98-ad58-89cba1dbe52b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:14.429756 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c7309025-af0c-4b98-ad58-89cba1dbe52b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:14.430572 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c7309025-af0c-4b98-ad58-89cba1dbe52b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:14.431038 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c7309025-af0c-4b98-ad58-89cba1dbe52b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:14.536205 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-c7309025-af0c-4b98-ad58-89cba1dbe52b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 31607 microversion: 2.20 time: 0.118309 Dec 15 13:34:14.537022 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 271/552] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:34:14 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 31607 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:34:14.868323 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-84cafe9d-5aa1-48be-a9f2-f7a8c8a06b17 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:14.868939 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-84cafe9d-5aa1-48be-a9f2-f7a8c8a06b17 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] [instance: 9dc28a7e-3433-4b18-b45e-9818080b2f7b] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:14.875242 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-84cafe9d-5aa1-48be-a9f2-f7a8c8a06b17 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:14.875700 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-84cafe9d-5aa1-48be-a9f2-f7a8c8a06b17 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:14.876488 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-84cafe9d-5aa1-48be-a9f2-f7a8c8a06b17 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:14.876931 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-84cafe9d-5aa1-48be-a9f2-f7a8c8a06b17 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:14.937846 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-535c8c74-e5b8-47db-a83f-295c628b71fc tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:14.938709 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-535c8c74-e5b8-47db-a83f-295c628b71fc tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:14.946074 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-535c8c74-e5b8-47db-a83f-295c628b71fc tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:14.946523 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-535c8c74-e5b8-47db-a83f-295c628b71fc tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:14.947340 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-535c8c74-e5b8-47db-a83f-295c628b71fc tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:14.947799 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-535c8c74-e5b8-47db-a83f-295c628b71fc tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:15.036909 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-84cafe9d-5aa1-48be-a9f2-f7a8c8a06b17 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52a2c8071134b07bdc222088246a671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050149bd93864d2abd0b342b8062d3d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:15.045292 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-84cafe9d-5aa1-48be-a9f2-f7a8c8a06b17 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] 10.222.0.60 "GET /compute/v2.1/servers/9dc28a7e-3433-4b18-b45e-9818080b2f7b" status: 200 len: 1313 microversion: 2.1 time: 0.181183 Dec 15 13:34:15.045885 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 282/553] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:14 2021] GET /compute/v2.1/servers/9dc28a7e-3433-4b18-b45e-9818080b2f7b => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:34:15.050208 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-0b441a88-bef5-4b20-a8c5-e7895051d51b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:15.051652 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-0b441a88-bef5-4b20-a8c5-e7895051d51b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:15.057077 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0b441a88-bef5-4b20-a8c5-e7895051d51b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:15.057538 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0b441a88-bef5-4b20-a8c5-e7895051d51b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:15.058370 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0b441a88-bef5-4b20-a8c5-e7895051d51b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:15.058828 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0b441a88-bef5-4b20-a8c5-e7895051d51b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:15.106473 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-535c8c74-e5b8-47db-a83f-295c628b71fc tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:15.114119 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-535c8c74-e5b8-47db-a83f-295c628b71fc tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a" status: 200 len: 1567 microversion: 2.1 time: 0.180981 Dec 15 13:34:15.114686 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 272/554] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:14 2021] GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a => generated 1567 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:34:15.153572 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-0b441a88-bef5-4b20-a8c5-e7895051d51b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 30032 microversion: 2.1 time: 0.106413 Dec 15 13:34:15.154220 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 283/555] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:34:15 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 30032 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:34:15.548413 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-e50dded1-766e-4d2f-8713-c03b8f67bcea tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:15.549395 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-e50dded1-766e-4d2f-8713-c03b8f67bcea tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:15.555744 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e50dded1-766e-4d2f-8713-c03b8f67bcea tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:15.556201 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e50dded1-766e-4d2f-8713-c03b8f67bcea tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:15.556986 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e50dded1-766e-4d2f-8713-c03b8f67bcea tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:15.557429 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e50dded1-766e-4d2f-8713-c03b8f67bcea tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:15.604136 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-31ca2f0e-cefc-4428-aa7a-2f1e6cbbb85e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:15.604750 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-31ca2f0e-cefc-4428-aa7a-2f1e6cbbb85e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 638afde5-46d2-4df0-9d04-d24b9d7aee64] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:15.612290 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-31ca2f0e-cefc-4428-aa7a-2f1e6cbbb85e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:15.612747 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-31ca2f0e-cefc-4428-aa7a-2f1e6cbbb85e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:15.613525 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-31ca2f0e-cefc-4428-aa7a-2f1e6cbbb85e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:15.613964 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-31ca2f0e-cefc-4428-aa7a-2f1e6cbbb85e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:15.638132 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-31ca2f0e-cefc-4428-aa7a-2f1e6cbbb85e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 638afde5-46d2-4df0-9d04-d24b9d7aee64] Going to try to terminate instance {{(pid=116942) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:34:15.667404 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-e50dded1-766e-4d2f-8713-c03b8f67bcea tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 32106 microversion: 2.20 time: 0.122396 Dec 15 13:34:15.669629 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 273/556] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:34:15 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 32106 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:34:15.712016 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-31ca2f0e-cefc-4428-aa7a-2f1e6cbbb85e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "DELETE /compute/v2.1/servers/638afde5-46d2-4df0-9d04-d24b9d7aee64" status: 204 len: 0 microversion: 2.1 time: 0.111638 Dec 15 13:34:15.712623 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 284/557] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Dec 15 13:34:15 2021] DELETE /compute/v2.1/servers/638afde5-46d2-4df0-9d04-d24b9d7aee64 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 15 13:34:15.721836 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-77f7a427-f778-4795-a06f-45ddd25a87c0 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:15.722677 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-77f7a427-f778-4795-a06f-45ddd25a87c0 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 638afde5-46d2-4df0-9d04-d24b9d7aee64] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:15.729712 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-77f7a427-f778-4795-a06f-45ddd25a87c0 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:15.730170 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-77f7a427-f778-4795-a06f-45ddd25a87c0 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:15.731011 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-77f7a427-f778-4795-a06f-45ddd25a87c0 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:15.731452 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-77f7a427-f778-4795-a06f-45ddd25a87c0 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:15.865050 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-77f7a427-f778-4795-a06f-45ddd25a87c0 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:15.872287 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-77f7a427-f778-4795-a06f-45ddd25a87c0 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/638afde5-46d2-4df0-9d04-d24b9d7aee64" status: 200 len: 1515 microversion: 2.1 time: 0.154737 Dec 15 13:34:15.872866 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 274/558] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:15 2021] GET /compute/v2.1/servers/638afde5-46d2-4df0-9d04-d24b9d7aee64 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:34:16.062299 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-21273f9d-5374-4d77-a4eb-022781b7238c tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:16.063045 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-21273f9d-5374-4d77-a4eb-022781b7238c tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] [instance: 9dc28a7e-3433-4b18-b45e-9818080b2f7b] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:16.069314 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-21273f9d-5374-4d77-a4eb-022781b7238c tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:16.069777 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-21273f9d-5374-4d77-a4eb-022781b7238c tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:16.070825 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-21273f9d-5374-4d77-a4eb-022781b7238c tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:16.071297 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-21273f9d-5374-4d77-a4eb-022781b7238c tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:16.131588 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-1a645610-b6c6-4792-aff1-8a81f147b101 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:16.132205 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-1a645610-b6c6-4792-aff1-8a81f147b101 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:16.139193 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1a645610-b6c6-4792-aff1-8a81f147b101 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:16.139679 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1a645610-b6c6-4792-aff1-8a81f147b101 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:16.140537 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1a645610-b6c6-4792-aff1-8a81f147b101 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:16.140981 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1a645610-b6c6-4792-aff1-8a81f147b101 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:16.225518 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-21273f9d-5374-4d77-a4eb-022781b7238c tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52a2c8071134b07bdc222088246a671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050149bd93864d2abd0b342b8062d3d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:16.233820 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-21273f9d-5374-4d77-a4eb-022781b7238c tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] 10.222.0.60 "GET /compute/v2.1/servers/9dc28a7e-3433-4b18-b45e-9818080b2f7b" status: 200 len: 1313 microversion: 2.1 time: 0.176026 Dec 15 13:34:16.234412 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 285/559] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:16 2021] GET /compute/v2.1/servers/9dc28a7e-3433-4b18-b45e-9818080b2f7b => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:34:16.238758 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-73d3b631-2ef4-4ea1-81ce-63f532fedf98 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:16.239697 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-73d3b631-2ef4-4ea1-81ce-63f532fedf98 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:16.245551 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-73d3b631-2ef4-4ea1-81ce-63f532fedf98 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:16.246008 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-73d3b631-2ef4-4ea1-81ce-63f532fedf98 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:16.247332 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-73d3b631-2ef4-4ea1-81ce-63f532fedf98 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:16.247776 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-73d3b631-2ef4-4ea1-81ce-63f532fedf98 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:16.296866 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-1a645610-b6c6-4792-aff1-8a81f147b101 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:16.304466 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-1a645610-b6c6-4792-aff1-8a81f147b101 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a" status: 200 len: 1567 microversion: 2.1 time: 0.176544 Dec 15 13:34:16.305042 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 275/560] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:16 2021] GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:34:16.354920 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-73d3b631-2ef4-4ea1-81ce-63f532fedf98 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 32281 microversion: 2.1 time: 0.119121 Dec 15 13:34:16.355494 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 286/561] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:34:16 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 32281 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:34:16.679669 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-22c91ac3-2cab-482a-a0b5-86e7d42b6e5c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:16.680582 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-22c91ac3-2cab-482a-a0b5-86e7d42b6e5c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:16.687156 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-22c91ac3-2cab-482a-a0b5-86e7d42b6e5c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:16.687616 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-22c91ac3-2cab-482a-a0b5-86e7d42b6e5c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:16.688410 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-22c91ac3-2cab-482a-a0b5-86e7d42b6e5c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:16.688850 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-22c91ac3-2cab-482a-a0b5-86e7d42b6e5c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:16.777236 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-22c91ac3-2cab-482a-a0b5-86e7d42b6e5c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 32766 microversion: 2.20 time: 0.101206 Dec 15 13:34:16.778808 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 276/562] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:34:16 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 32766 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:34:16.890920 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-c52dfd52-4a5b-491e-b61e-e1c7a323af3b tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:16.891759 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-c52dfd52-4a5b-491e-b61e-e1c7a323af3b tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 638afde5-46d2-4df0-9d04-d24b9d7aee64] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:16.898926 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c52dfd52-4a5b-491e-b61e-e1c7a323af3b tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:16.899375 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c52dfd52-4a5b-491e-b61e-e1c7a323af3b tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:16.902537 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c52dfd52-4a5b-491e-b61e-e1c7a323af3b tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:16.903047 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c52dfd52-4a5b-491e-b61e-e1c7a323af3b tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:17.054480 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-c52dfd52-4a5b-491e-b61e-e1c7a323af3b tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:17.065598 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-c52dfd52-4a5b-491e-b61e-e1c7a323af3b tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/638afde5-46d2-4df0-9d04-d24b9d7aee64" status: 200 len: 1515 microversion: 2.1 time: 0.179568 Dec 15 13:34:17.066180 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 287/563] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:16 2021] GET /compute/v2.1/servers/638afde5-46d2-4df0-9d04-d24b9d7aee64 => generated 1515 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:34:17.113528 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-5840fd13-b758-4d52-a37d-de191e2d0add req-a2c9b145-d2cf-4042-bf8c-cf6c04fd95ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dc28a7e-3433-4b18-b45e-9818080b2f7b", "name": "network-vif-plugged", "status": "completed", "tag": "d9f33076-1c2e-4ce1-822b-f66e969079f6"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:17.115053 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:34:17.115053 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: warnings.warn(msg) Dec 15 13:34:17.125577 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-5840fd13-b758-4d52-a37d-de191e2d0add req-a2c9b145-d2cf-4042-bf8c-cf6c04fd95ed service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:17.126042 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-5840fd13-b758-4d52-a37d-de191e2d0add req-a2c9b145-d2cf-4042-bf8c-cf6c04fd95ed service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:17.138199 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-5840fd13-b758-4d52-a37d-de191e2d0add req-a2c9b145-d2cf-4042-bf8c-cf6c04fd95ed service nova] Creating event network-vif-plugged:d9f33076-1c2e-4ce1-822b-f66e969079f6 for instance 9dc28a7e-3433-4b18-b45e-9818080b2f7b on hv-cinder-81322 Dec 15 13:34:17.144783 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-5840fd13-b758-4d52-a37d-de191e2d0add req-a2c9b145-d2cf-4042-bf8c-cf6c04fd95ed service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035063 Dec 15 13:34:17.145397 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 277/564] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:34:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:34:17.252175 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-86727818-6f1b-4b55-b13b-893b7000621f tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:17.252751 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-86727818-6f1b-4b55-b13b-893b7000621f tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] [instance: 9dc28a7e-3433-4b18-b45e-9818080b2f7b] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:17.259207 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-86727818-6f1b-4b55-b13b-893b7000621f tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:17.259600 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-86727818-6f1b-4b55-b13b-893b7000621f tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:17.260527 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-86727818-6f1b-4b55-b13b-893b7000621f tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:17.260974 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-86727818-6f1b-4b55-b13b-893b7000621f tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:17.323003 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-df3c1a2d-4bdc-43df-bcd1-ac76c8ff6847 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:17.323765 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-df3c1a2d-4bdc-43df-bcd1-ac76c8ff6847 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:17.330223 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-df3c1a2d-4bdc-43df-bcd1-ac76c8ff6847 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:17.330672 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-df3c1a2d-4bdc-43df-bcd1-ac76c8ff6847 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:17.331489 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-df3c1a2d-4bdc-43df-bcd1-ac76c8ff6847 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:17.332065 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-df3c1a2d-4bdc-43df-bcd1-ac76c8ff6847 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:17.433749 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-86727818-6f1b-4b55-b13b-893b7000621f tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52a2c8071134b07bdc222088246a671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050149bd93864d2abd0b342b8062d3d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:17.441626 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-86727818-6f1b-4b55-b13b-893b7000621f tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] 10.222.0.60 "GET /compute/v2.1/servers/9dc28a7e-3433-4b18-b45e-9818080b2f7b" status: 200 len: 1313 microversion: 2.1 time: 0.193233 Dec 15 13:34:17.442235 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 288/565] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:17 2021] GET /compute/v2.1/servers/9dc28a7e-3433-4b18-b45e-9818080b2f7b => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:34:17.448075 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-540b6008-98fe-48b4-a27e-3ab1e38523cf tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:17.449049 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-540b6008-98fe-48b4-a27e-3ab1e38523cf tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:17.460703 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-540b6008-98fe-48b4-a27e-3ab1e38523cf tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:17.460703 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-540b6008-98fe-48b4-a27e-3ab1e38523cf tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:17.461661 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-540b6008-98fe-48b4-a27e-3ab1e38523cf tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:17.463039 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-540b6008-98fe-48b4-a27e-3ab1e38523cf tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:17.495628 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-df3c1a2d-4bdc-43df-bcd1-ac76c8ff6847 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:17.504155 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-df3c1a2d-4bdc-43df-bcd1-ac76c8ff6847 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a" status: 200 len: 1567 microversion: 2.1 time: 0.186287 Dec 15 13:34:17.504641 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 278/566] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:17 2021] GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a => generated 1567 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:34:17.760210 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-540b6008-98fe-48b4-a27e-3ab1e38523cf tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 33122 microversion: 2.1 time: 0.316597 Dec 15 13:34:17.760836 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 289/567] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:34:17 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 33122 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:34:17.789341 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-ad3e71fb-7935-4fe6-a1bf-2febcc8b3d9a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:17.790265 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-ad3e71fb-7935-4fe6-a1bf-2febcc8b3d9a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:17.797161 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ad3e71fb-7935-4fe6-a1bf-2febcc8b3d9a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:17.797619 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ad3e71fb-7935-4fe6-a1bf-2febcc8b3d9a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:17.798402 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ad3e71fb-7935-4fe6-a1bf-2febcc8b3d9a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:17.798864 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ad3e71fb-7935-4fe6-a1bf-2febcc8b3d9a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:17.904204 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-ad3e71fb-7935-4fe6-a1bf-2febcc8b3d9a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 33255 microversion: 2.20 time: 0.118378 Dec 15 13:34:17.904850 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 279/568] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:34:17 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 33255 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:34:18.083708 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-47045068-3fb7-413f-9b2e-97addbc211e8 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:18.084338 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-47045068-3fb7-413f-9b2e-97addbc211e8 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 638afde5-46d2-4df0-9d04-d24b9d7aee64] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:18.091808 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-47045068-3fb7-413f-9b2e-97addbc211e8 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:18.092269 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-47045068-3fb7-413f-9b2e-97addbc211e8 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:18.093051 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-47045068-3fb7-413f-9b2e-97addbc211e8 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:18.093490 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-47045068-3fb7-413f-9b2e-97addbc211e8 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:18.224449 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-47045068-3fb7-413f-9b2e-97addbc211e8 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:18.232141 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-47045068-3fb7-413f-9b2e-97addbc211e8 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/638afde5-46d2-4df0-9d04-d24b9d7aee64" status: 200 len: 1515 microversion: 2.1 time: 0.152556 Dec 15 13:34:18.232713 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 290/569] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:18 2021] GET /compute/v2.1/servers/638afde5-46d2-4df0-9d04-d24b9d7aee64 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:34:18.459257 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-d3ced4ba-c68c-4a65-b42f-801674c8dec2 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:18.459923 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-d3ced4ba-c68c-4a65-b42f-801674c8dec2 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] [instance: 9dc28a7e-3433-4b18-b45e-9818080b2f7b] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:18.466977 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d3ced4ba-c68c-4a65-b42f-801674c8dec2 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:18.467420 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d3ced4ba-c68c-4a65-b42f-801674c8dec2 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:18.468196 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d3ced4ba-c68c-4a65-b42f-801674c8dec2 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:18.468626 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d3ced4ba-c68c-4a65-b42f-801674c8dec2 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:18.520727 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-5c06fee2-4af2-45aa-8805-c65c730f8fc7 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:18.521339 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-5c06fee2-4af2-45aa-8805-c65c730f8fc7 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:18.527770 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5c06fee2-4af2-45aa-8805-c65c730f8fc7 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:18.528224 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5c06fee2-4af2-45aa-8805-c65c730f8fc7 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:18.529018 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5c06fee2-4af2-45aa-8805-c65c730f8fc7 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:18.529464 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5c06fee2-4af2-45aa-8805-c65c730f8fc7 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:18.642222 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-d3ced4ba-c68c-4a65-b42f-801674c8dec2 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52a2c8071134b07bdc222088246a671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050149bd93864d2abd0b342b8062d3d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:18.649573 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-d3ced4ba-c68c-4a65-b42f-801674c8dec2 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] 10.222.0.60 "GET /compute/v2.1/servers/9dc28a7e-3433-4b18-b45e-9818080b2f7b" status: 200 len: 1313 microversion: 2.1 time: 0.194483 Dec 15 13:34:18.650149 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 280/570] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:18 2021] GET /compute/v2.1/servers/9dc28a7e-3433-4b18-b45e-9818080b2f7b => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:34:18.688298 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-5c06fee2-4af2-45aa-8805-c65c730f8fc7 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:18.697278 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-5c06fee2-4af2-45aa-8805-c65c730f8fc7 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a" status: 200 len: 1567 microversion: 2.1 time: 0.180278 Dec 15 13:34:18.697874 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 291/571] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:18 2021] GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a => generated 1567 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:34:18.771991 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-24916f90-6244-4bde-87f1-ce6b41eae7c6 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:18.772960 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-24916f90-6244-4bde-87f1-ce6b41eae7c6 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:18.779296 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-24916f90-6244-4bde-87f1-ce6b41eae7c6 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:18.779742 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-24916f90-6244-4bde-87f1-ce6b41eae7c6 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:18.780520 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-24916f90-6244-4bde-87f1-ce6b41eae7c6 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:18.780952 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-24916f90-6244-4bde-87f1-ce6b41eae7c6 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:18.916074 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ae26c895-abab-4542-95a1-d033faa4fff9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:18.917115 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ae26c895-abab-4542-95a1-d033faa4fff9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:18.928983 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ae26c895-abab-4542-95a1-d033faa4fff9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:18.929439 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ae26c895-abab-4542-95a1-d033faa4fff9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:18.930239 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ae26c895-abab-4542-95a1-d033faa4fff9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:18.930683 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ae26c895-abab-4542-95a1-d033faa4fff9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:18.940172 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-24916f90-6244-4bde-87f1-ce6b41eae7c6 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 33955 microversion: 2.1 time: 0.171477 Dec 15 13:34:18.940719 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 281/572] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:34:18 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 33955 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:34:19.054505 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ae26c895-abab-4542-95a1-d033faa4fff9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 33795 microversion: 2.20 time: 0.141873 Dec 15 13:34:19.055572 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 292/573] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:34:18 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 33795 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:34:19.164129 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-c520eb3b-ed8d-413c-a483-c317a92a093b req-bce380da-4840-4de6-a3cb-02eac71e7f5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "638afde5-46d2-4df0-9d04-d24b9d7aee64", "name": "network-vif-deleted", "tag": "73028c18-6a30-4deb-9114-51244b03f4f4"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:19.165661 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:34:19.165661 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: warnings.warn(msg) Dec 15 13:34:19.174829 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-c520eb3b-ed8d-413c-a483-c317a92a093b req-bce380da-4840-4de6-a3cb-02eac71e7f5d service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:19.175301 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-c520eb3b-ed8d-413c-a483-c317a92a093b req-bce380da-4840-4de6-a3cb-02eac71e7f5d service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:19.188303 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-c520eb3b-ed8d-413c-a483-c317a92a093b req-bce380da-4840-4de6-a3cb-02eac71e7f5d service nova] Creating event network-vif-deleted:73028c18-6a30-4deb-9114-51244b03f4f4 for instance 638afde5-46d2-4df0-9d04-d24b9d7aee64 on hv-cinder-81322 Dec 15 13:34:19.193192 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-c520eb3b-ed8d-413c-a483-c317a92a093b req-bce380da-4840-4de6-a3cb-02eac71e7f5d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032984 Dec 15 13:34:19.193827 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 282/574] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:34:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:34:19.248736 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-4ad0dcb1-4d86-48b0-885b-51d40e72434c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:19.249431 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-4ad0dcb1-4d86-48b0-885b-51d40e72434c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 638afde5-46d2-4df0-9d04-d24b9d7aee64] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:19.257719 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4ad0dcb1-4d86-48b0-885b-51d40e72434c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:19.258180 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4ad0dcb1-4d86-48b0-885b-51d40e72434c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:19.259008 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4ad0dcb1-4d86-48b0-885b-51d40e72434c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:19.259451 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4ad0dcb1-4d86-48b0-885b-51d40e72434c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:19.291883 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4ad0dcb1-4d86-48b0-885b-51d40e72434c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:19.292345 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4ad0dcb1-4d86-48b0-885b-51d40e72434c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:19.292803 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.objects.instance [None req-4ad0dcb1-4d86-48b0-885b-51d40e72434c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lazy-loading 'fault' on Instance uuid 638afde5-46d2-4df0-9d04-d24b9d7aee64 {{(pid=116942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:34:19.336306 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-4ad0dcb1-4d86-48b0-885b-51d40e72434c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:19.345339 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-4ad0dcb1-4d86-48b0-885b-51d40e72434c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/638afde5-46d2-4df0-9d04-d24b9d7aee64" status: 200 len: 1308 microversion: 2.1 time: 0.100677 Dec 15 13:34:19.346055 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 293/575] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:19 2021] GET /compute/v2.1/servers/638afde5-46d2-4df0-9d04-d24b9d7aee64 => generated 1308 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:34:19.669612 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-c77a49bb-da79-465b-9f0a-a27dc424daf5 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:19.670241 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-c77a49bb-da79-465b-9f0a-a27dc424daf5 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] [instance: 9dc28a7e-3433-4b18-b45e-9818080b2f7b] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:19.676324 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c77a49bb-da79-465b-9f0a-a27dc424daf5 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:19.676783 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c77a49bb-da79-465b-9f0a-a27dc424daf5 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:19.677567 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c77a49bb-da79-465b-9f0a-a27dc424daf5 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:19.678010 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c77a49bb-da79-465b-9f0a-a27dc424daf5 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:19.713135 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-4cd10356-2cb2-4e79-9497-0d58718351ea tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:19.713916 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-4cd10356-2cb2-4e79-9497-0d58718351ea tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:19.720895 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4cd10356-2cb2-4e79-9497-0d58718351ea tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:19.721428 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4cd10356-2cb2-4e79-9497-0d58718351ea tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:19.722228 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4cd10356-2cb2-4e79-9497-0d58718351ea tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:19.722674 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4cd10356-2cb2-4e79-9497-0d58718351ea tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:19.852932 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-c77a49bb-da79-465b-9f0a-a27dc424daf5 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52a2c8071134b07bdc222088246a671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050149bd93864d2abd0b342b8062d3d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:19.861308 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-c77a49bb-da79-465b-9f0a-a27dc424daf5 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] 10.222.0.60 "GET /compute/v2.1/servers/9dc28a7e-3433-4b18-b45e-9818080b2f7b" status: 200 len: 1313 microversion: 2.1 time: 0.195512 Dec 15 13:34:19.870761 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 283/576] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:19 2021] GET /compute/v2.1/servers/9dc28a7e-3433-4b18-b45e-9818080b2f7b => generated 1313 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:34:19.897920 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-4cd10356-2cb2-4e79-9497-0d58718351ea tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:19.905950 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-4cd10356-2cb2-4e79-9497-0d58718351ea tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a" status: 200 len: 1567 microversion: 2.1 time: 0.196399 Dec 15 13:34:19.906523 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 294/577] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:19 2021] GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a => generated 1567 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:34:19.952387 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-4e862335-3259-412d-b0b7-74e82bce3f7d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:19.953221 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-4e862335-3259-412d-b0b7-74e82bce3f7d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:19.959698 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4e862335-3259-412d-b0b7-74e82bce3f7d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:19.960156 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4e862335-3259-412d-b0b7-74e82bce3f7d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:19.960946 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4e862335-3259-412d-b0b7-74e82bce3f7d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:19.961391 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4e862335-3259-412d-b0b7-74e82bce3f7d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:20.065919 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-60072b9c-7b8f-498b-93b4-8fd7933258c7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:20.066840 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-60072b9c-7b8f-498b-93b4-8fd7933258c7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:20.072874 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-60072b9c-7b8f-498b-93b4-8fd7933258c7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:20.073338 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-60072b9c-7b8f-498b-93b4-8fd7933258c7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:20.074174 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-60072b9c-7b8f-498b-93b4-8fd7933258c7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:20.075294 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-60072b9c-7b8f-498b-93b4-8fd7933258c7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:20.099592 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-4e862335-3259-412d-b0b7-74e82bce3f7d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 34360 microversion: 2.1 time: 0.151398 Dec 15 13:34:20.100252 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 284/578] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:34:19 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 34360 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:34:20.179801 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-60072b9c-7b8f-498b-93b4-8fd7933258c7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 34370 microversion: 2.20 time: 0.117454 Dec 15 13:34:20.180484 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 295/579] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:34:20 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 34370 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:34:20.363079 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-e4b5f243-6d7d-459b-86b8-95a65b3e281d tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:20.363789 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-e4b5f243-6d7d-459b-86b8-95a65b3e281d tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 638afde5-46d2-4df0-9d04-d24b9d7aee64] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:20.370531 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e4b5f243-6d7d-459b-86b8-95a65b3e281d tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:20.371023 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e4b5f243-6d7d-459b-86b8-95a65b3e281d tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:20.372415 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e4b5f243-6d7d-459b-86b8-95a65b3e281d tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:20.372857 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e4b5f243-6d7d-459b-86b8-95a65b3e281d tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:20.386953 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.wsgi [None req-e4b5f243-6d7d-459b-86b8-95a65b3e281d tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] HTTP exception thrown: Instance 638afde5-46d2-4df0-9d04-d24b9d7aee64 could not be found. Dec 15 13:34:20.387550 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-e4b5f243-6d7d-459b-86b8-95a65b3e281d tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Returning 404 to user: Instance 638afde5-46d2-4df0-9d04-d24b9d7aee64 could not be found. {{(pid=116941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:34:20.388371 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-e4b5f243-6d7d-459b-86b8-95a65b3e281d tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/638afde5-46d2-4df0-9d04-d24b9d7aee64" status: 404 len: 111 microversion: 2.1 time: 0.029375 Dec 15 13:34:20.388918 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 285/580] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:20 2021] GET /compute/v2.1/servers/638afde5-46d2-4df0-9d04-d24b9d7aee64 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:34:20.878201 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-fd93bd6a-43a0-4224-a8d7-2dba3f01aaac tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:20.878931 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-fd93bd6a-43a0-4224-a8d7-2dba3f01aaac tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] [instance: 9dc28a7e-3433-4b18-b45e-9818080b2f7b] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:20.885818 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-fd93bd6a-43a0-4224-a8d7-2dba3f01aaac tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:20.886276 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-fd93bd6a-43a0-4224-a8d7-2dba3f01aaac tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:20.887101 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-fd93bd6a-43a0-4224-a8d7-2dba3f01aaac tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:20.887543 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-fd93bd6a-43a0-4224-a8d7-2dba3f01aaac tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:20.923468 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-d16c6e1f-220c-475b-a53c-341665d936bc tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:20.924103 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-d16c6e1f-220c-475b-a53c-341665d936bc tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:20.930440 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d16c6e1f-220c-475b-a53c-341665d936bc tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:20.931138 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d16c6e1f-220c-475b-a53c-341665d936bc tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:20.932016 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d16c6e1f-220c-475b-a53c-341665d936bc tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:20.932526 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d16c6e1f-220c-475b-a53c-341665d936bc tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:21.058244 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-fd93bd6a-43a0-4224-a8d7-2dba3f01aaac tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52a2c8071134b07bdc222088246a671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050149bd93864d2abd0b342b8062d3d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:21.065684 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-fd93bd6a-43a0-4224-a8d7-2dba3f01aaac tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] 10.222.0.60 "GET /compute/v2.1/servers/9dc28a7e-3433-4b18-b45e-9818080b2f7b" status: 200 len: 1496 microversion: 2.1 time: 0.191647 Dec 15 13:34:21.066263 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 296/581] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:20 2021] GET /compute/v2.1/servers/9dc28a7e-3433-4b18-b45e-9818080b2f7b => generated 1496 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:34:21.102262 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-d16c6e1f-220c-475b-a53c-341665d936bc tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:21.110744 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-d16c6e1f-220c-475b-a53c-341665d936bc tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a" status: 200 len: 1567 microversion: 2.1 time: 0.190963 Dec 15 13:34:21.111361 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ab30a619-12ed-4df6-9265-596e37ad2b14 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:21.111505 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 286/582] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:20 2021] GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a => generated 1567 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:34:21.112506 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ab30a619-12ed-4df6-9265-596e37ad2b14 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:21.118655 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ab30a619-12ed-4df6-9265-596e37ad2b14 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:21.119139 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ab30a619-12ed-4df6-9265-596e37ad2b14 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:21.119921 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ab30a619-12ed-4df6-9265-596e37ad2b14 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:21.120425 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ab30a619-12ed-4df6-9265-596e37ad2b14 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:21.192424 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-1c9b46ff-e15f-40e6-a72a-3bb62292f04d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:21.193268 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-1c9b46ff-e15f-40e6-a72a-3bb62292f04d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:21.200359 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1c9b46ff-e15f-40e6-a72a-3bb62292f04d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:21.200817 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1c9b46ff-e15f-40e6-a72a-3bb62292f04d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:21.201651 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1c9b46ff-e15f-40e6-a72a-3bb62292f04d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:21.202054 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1c9b46ff-e15f-40e6-a72a-3bb62292f04d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:21.232777 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ab30a619-12ed-4df6-9265-596e37ad2b14 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 34776 microversion: 2.1 time: 0.124780 Dec 15 13:34:21.236106 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 297/583] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:34:21 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 34776 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:34:21.297051 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-1c9b46ff-e15f-40e6-a72a-3bb62292f04d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 36917 microversion: 2.20 time: 0.108241 Dec 15 13:34:21.298100 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 287/584] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:34:21 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 36917 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:34:21.514253 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-e4197076-36d1-4e95-92e9-23a244f1b7e8 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:21.514836 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-e4197076-36d1-4e95-92e9-23a244f1b7e8 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 20c19dcc-7224-44dc-8921-a03017d002d7] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:21.521720 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e4197076-36d1-4e95-92e9-23a244f1b7e8 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:21.522173 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e4197076-36d1-4e95-92e9-23a244f1b7e8 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:21.522998 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e4197076-36d1-4e95-92e9-23a244f1b7e8 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:21.523442 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e4197076-36d1-4e95-92e9-23a244f1b7e8 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:21.548219 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-e4197076-36d1-4e95-92e9-23a244f1b7e8 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 20c19dcc-7224-44dc-8921-a03017d002d7] Going to try to terminate instance {{(pid=116942) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:34:21.555270 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-d3eaa661-8e82-4c81-8308-352cfe3d190e tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:21.555884 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-d3eaa661-8e82-4c81-8308-352cfe3d190e tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] [instance: 9dc28a7e-3433-4b18-b45e-9818080b2f7b] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:21.563709 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d3eaa661-8e82-4c81-8308-352cfe3d190e tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:21.564156 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d3eaa661-8e82-4c81-8308-352cfe3d190e tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:21.564929 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d3eaa661-8e82-4c81-8308-352cfe3d190e tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:21.565360 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d3eaa661-8e82-4c81-8308-352cfe3d190e tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:21.590919 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-d3eaa661-8e82-4c81-8308-352cfe3d190e tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] [instance: 9dc28a7e-3433-4b18-b45e-9818080b2f7b] Going to try to terminate instance {{(pid=116941) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:34:21.622253 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-e4197076-36d1-4e95-92e9-23a244f1b7e8 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "DELETE /compute/v2.1/servers/20c19dcc-7224-44dc-8921-a03017d002d7" status: 204 len: 0 microversion: 2.1 time: 0.111773 Dec 15 13:34:21.622856 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 298/585] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Dec 15 13:34:21 2021] DELETE /compute/v2.1/servers/20c19dcc-7224-44dc-8921-a03017d002d7 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:34:21.631688 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-973e5b74-b949-43ad-a1d9-69bc24792f65 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:21.632476 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-973e5b74-b949-43ad-a1d9-69bc24792f65 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 20c19dcc-7224-44dc-8921-a03017d002d7] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:21.640124 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-973e5b74-b949-43ad-a1d9-69bc24792f65 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:21.640804 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-973e5b74-b949-43ad-a1d9-69bc24792f65 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:21.641678 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-973e5b74-b949-43ad-a1d9-69bc24792f65 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:21.642311 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-973e5b74-b949-43ad-a1d9-69bc24792f65 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:21.682651 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-d3eaa661-8e82-4c81-8308-352cfe3d190e tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9dc28a7e-3433-4b18-b45e-9818080b2f7b" status: 204 len: 0 microversion: 2.1 time: 0.131048 Dec 15 13:34:21.683784 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 288/586] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Dec 15 13:34:21 2021] DELETE /compute/v2.1/servers/9dc28a7e-3433-4b18-b45e-9818080b2f7b => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 15 13:34:21.692206 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-83f9a0e8-ab89-4d68-890a-a4ffa4c06244 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:21.693173 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-83f9a0e8-ab89-4d68-890a-a4ffa4c06244 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] [instance: 9dc28a7e-3433-4b18-b45e-9818080b2f7b] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:21.698973 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-83f9a0e8-ab89-4d68-890a-a4ffa4c06244 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:21.699465 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-83f9a0e8-ab89-4d68-890a-a4ffa4c06244 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:21.700259 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-83f9a0e8-ab89-4d68-890a-a4ffa4c06244 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:21.700695 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-83f9a0e8-ab89-4d68-890a-a4ffa4c06244 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:21.817999 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-973e5b74-b949-43ad-a1d9-69bc24792f65 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:21.825877 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-973e5b74-b949-43ad-a1d9-69bc24792f65 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/20c19dcc-7224-44dc-8921-a03017d002d7" status: 200 len: 1513 microversion: 2.1 time: 0.198819 Dec 15 13:34:21.826542 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 299/587] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:21 2021] GET /compute/v2.1/servers/20c19dcc-7224-44dc-8921-a03017d002d7 => generated 1513 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:34:21.860876 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-83f9a0e8-ab89-4d68-890a-a4ffa4c06244 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52a2c8071134b07bdc222088246a671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050149bd93864d2abd0b342b8062d3d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:21.868126 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-83f9a0e8-ab89-4d68-890a-a4ffa4c06244 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] 10.222.0.60 "GET /compute/v2.1/servers/9dc28a7e-3433-4b18-b45e-9818080b2f7b" status: 200 len: 1502 microversion: 2.1 time: 0.179906 Dec 15 13:34:21.868702 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 289/588] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:21 2021] GET /compute/v2.1/servers/9dc28a7e-3433-4b18-b45e-9818080b2f7b => generated 1502 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:34:22.128549 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-077efae5-e430-43dd-be85-c95498473ec7 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:22.129082 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-077efae5-e430-43dd-be85-c95498473ec7 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:22.135347 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-077efae5-e430-43dd-be85-c95498473ec7 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:22.135798 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-077efae5-e430-43dd-be85-c95498473ec7 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:22.136573 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-077efae5-e430-43dd-be85-c95498473ec7 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:22.137038 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-077efae5-e430-43dd-be85-c95498473ec7 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:22.244369 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-4c85f9ad-1c78-4369-919f-759e3d0dda3a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:22.245320 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-4c85f9ad-1c78-4369-919f-759e3d0dda3a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:22.254596 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4c85f9ad-1c78-4369-919f-759e3d0dda3a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:22.255154 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4c85f9ad-1c78-4369-919f-759e3d0dda3a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:22.255948 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4c85f9ad-1c78-4369-919f-759e3d0dda3a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:22.256382 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4c85f9ad-1c78-4369-919f-759e3d0dda3a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:22.271263 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-077efae5-e430-43dd-be85-c95498473ec7 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:22.279738 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-077efae5-e430-43dd-be85-c95498473ec7 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a" status: 200 len: 1567 microversion: 2.1 time: 0.154854 Dec 15 13:34:22.280327 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 300/589] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:22 2021] GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:34:22.308526 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-8178000a-59b0-4fea-a82e-e38980396555 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:22.309571 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-8178000a-59b0-4fea-a82e-e38980396555 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:22.315419 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8178000a-59b0-4fea-a82e-e38980396555 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:22.315879 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8178000a-59b0-4fea-a82e-e38980396555 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:22.316662 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8178000a-59b0-4fea-a82e-e38980396555 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:22.317106 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8178000a-59b0-4fea-a82e-e38980396555 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:22.382558 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-4c85f9ad-1c78-4369-919f-759e3d0dda3a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 35353 microversion: 2.1 time: 0.141527 Dec 15 13:34:22.383156 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 290/590] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:34:22 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 35353 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:34:22.451462 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-8178000a-59b0-4fea-a82e-e38980396555 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 37544 microversion: 2.20 time: 0.146187 Dec 15 13:34:22.455697 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 301/591] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:34:22 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 37544 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:34:22.843489 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-3c956a22-87d2-4c51-b0c4-6676f224bb0e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:22.844189 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-3c956a22-87d2-4c51-b0c4-6676f224bb0e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 20c19dcc-7224-44dc-8921-a03017d002d7] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:22.851007 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3c956a22-87d2-4c51-b0c4-6676f224bb0e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:22.851462 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3c956a22-87d2-4c51-b0c4-6676f224bb0e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:22.852247 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3c956a22-87d2-4c51-b0c4-6676f224bb0e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:22.852687 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3c956a22-87d2-4c51-b0c4-6676f224bb0e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:22.885747 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ca7a3d27-677b-4ade-aeae-d5d4c63766ad tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:22.886449 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ca7a3d27-677b-4ade-aeae-d5d4c63766ad tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] [instance: 9dc28a7e-3433-4b18-b45e-9818080b2f7b] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:22.893882 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ca7a3d27-677b-4ade-aeae-d5d4c63766ad tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:22.894335 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ca7a3d27-677b-4ade-aeae-d5d4c63766ad tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:22.895175 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ca7a3d27-677b-4ade-aeae-d5d4c63766ad tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:22.895617 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ca7a3d27-677b-4ade-aeae-d5d4c63766ad tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:23.022514 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-3c956a22-87d2-4c51-b0c4-6676f224bb0e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:23.029970 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-3c956a22-87d2-4c51-b0c4-6676f224bb0e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/20c19dcc-7224-44dc-8921-a03017d002d7" status: 200 len: 1513 microversion: 2.1 time: 0.190527 Dec 15 13:34:23.030545 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 291/592] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:22 2021] GET /compute/v2.1/servers/20c19dcc-7224-44dc-8921-a03017d002d7 => generated 1513 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:34:23.063729 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-ca7a3d27-677b-4ade-aeae-d5d4c63766ad tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52a2c8071134b07bdc222088246a671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050149bd93864d2abd0b342b8062d3d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:23.071233 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ca7a3d27-677b-4ade-aeae-d5d4c63766ad tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] 10.222.0.60 "GET /compute/v2.1/servers/9dc28a7e-3433-4b18-b45e-9818080b2f7b" status: 200 len: 1502 microversion: 2.1 time: 0.189370 Dec 15 13:34:23.071798 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 302/593] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:22 2021] GET /compute/v2.1/servers/9dc28a7e-3433-4b18-b45e-9818080b2f7b => generated 1502 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:34:23.297345 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-429e0621-176c-4b24-9518-3ac4080d0d88 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:23.297953 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-429e0621-176c-4b24-9518-3ac4080d0d88 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:23.304043 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-429e0621-176c-4b24-9518-3ac4080d0d88 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:23.304503 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-429e0621-176c-4b24-9518-3ac4080d0d88 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:23.305294 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-429e0621-176c-4b24-9518-3ac4080d0d88 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:23.305736 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-429e0621-176c-4b24-9518-3ac4080d0d88 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:23.393659 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-27835505-3ccb-4003-baa1-7d9be8753bc0 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:23.394756 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-27835505-3ccb-4003-baa1-7d9be8753bc0 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:23.401019 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-27835505-3ccb-4003-baa1-7d9be8753bc0 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:23.401475 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-27835505-3ccb-4003-baa1-7d9be8753bc0 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:23.402302 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-27835505-3ccb-4003-baa1-7d9be8753bc0 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:23.403885 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-27835505-3ccb-4003-baa1-7d9be8753bc0 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:23.434088 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-429e0621-176c-4b24-9518-3ac4080d0d88 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:23.441920 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-429e0621-176c-4b24-9518-3ac4080d0d88 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a" status: 200 len: 1547 microversion: 2.1 time: 0.149011 Dec 15 13:34:23.442494 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 292/594] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:23 2021] GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a => generated 1547 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:34:23.458425 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-1df2ec0d-b2af-4b6d-83e9-6ba765aa5434 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:23.458955 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-1df2ec0d-b2af-4b6d-83e9-6ba765aa5434 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:23.464568 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1df2ec0d-b2af-4b6d-83e9-6ba765aa5434 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:23.465674 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1df2ec0d-b2af-4b6d-83e9-6ba765aa5434 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:23.466469 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1df2ec0d-b2af-4b6d-83e9-6ba765aa5434 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:23.466944 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1df2ec0d-b2af-4b6d-83e9-6ba765aa5434 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:23.503923 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-27835505-3ccb-4003-baa1-7d9be8753bc0 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 35810 microversion: 2.1 time: 0.113649 Dec 15 13:34:23.504835 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 303/595] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:34:23 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 35810 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:34:23.510208 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-772e9b83-6fae-4981-9704-7eeea770ee68 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:23.511222 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-772e9b83-6fae-4981-9704-7eeea770ee68 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:23.518031 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-772e9b83-6fae-4981-9704-7eeea770ee68 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:23.518485 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-772e9b83-6fae-4981-9704-7eeea770ee68 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:23.519298 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-772e9b83-6fae-4981-9704-7eeea770ee68 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:23.519746 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-772e9b83-6fae-4981-9704-7eeea770ee68 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:23.543170 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.wsgi [None req-1df2ec0d-b2af-4b6d-83e9-6ba765aa5434 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] HTTP exception thrown: Cannot 'detach_volume' instance eab2a5ce-9a56-4120-ae3c-ddfb844aa30a while it is in vm_state rescued Dec 15 13:34:23.543768 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-1df2ec0d-b2af-4b6d-83e9-6ba765aa5434 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Returning 409 to user: Cannot 'detach_volume' instance eab2a5ce-9a56-4120-ae3c-ddfb844aa30a while it is in vm_state rescued {{(pid=116941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:34:23.544594 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-1df2ec0d-b2af-4b6d-83e9-6ba765aa5434 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "DELETE /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a/os-volume_attachments/12c3c743-9c46-452e-b4d2-b91656962919" status: 409 len: 152 microversion: 2.1 time: 0.089712 Dec 15 13:34:23.545144 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 293/596] 10.222.0.60 () {58 vars in 1415 bytes} [Wed Dec 15 13:34:23 2021] DELETE /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a/os-volume_attachments/12c3c743-9c46-452e-b4d2-b91656962919 => generated 152 bytes in 91 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Dec 15 13:34:23.553213 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-1f382662-4f04-40ef-a846-b4bc102fe359 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:23.553682 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-1f382662-4f04-40ef-a846-b4bc102fe359 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:23.560505 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1f382662-4f04-40ef-a846-b4bc102fe359 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:23.560955 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1f382662-4f04-40ef-a846-b4bc102fe359 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:23.561744 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1f382662-4f04-40ef-a846-b4bc102fe359 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:23.562184 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1f382662-4f04-40ef-a846-b4bc102fe359 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:23.624687 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-1f382662-4f04-40ef-a846-b4bc102fe359 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "POST /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a/action" status: 202 len: 0 microversion: 2.1 time: 0.075001 Dec 15 13:34:23.628276 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 294/597] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:34:23 2021] POST /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:34:23.633104 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-fa271ead-47bc-447b-bf04-e77ead5ec6bf tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:23.633803 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-fa271ead-47bc-447b-bf04-e77ead5ec6bf tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:23.640274 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-fa271ead-47bc-447b-bf04-e77ead5ec6bf tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:23.640732 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-fa271ead-47bc-447b-bf04-e77ead5ec6bf tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:23.641518 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-fa271ead-47bc-447b-bf04-e77ead5ec6bf tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:23.641966 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-fa271ead-47bc-447b-bf04-e77ead5ec6bf tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:23.653957 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-772e9b83-6fae-4981-9704-7eeea770ee68 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 38101 microversion: 2.20 time: 0.147774 Dec 15 13:34:23.655527 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 304/598] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:34:23 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 38101 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:34:23.781233 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-fa271ead-47bc-447b-bf04-e77ead5ec6bf tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:23.789006 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-fa271ead-47bc-447b-bf04-e77ead5ec6bf tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a" status: 200 len: 1555 microversion: 2.1 time: 0.159557 Dec 15 13:34:23.789584 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 295/599] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:23 2021] GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:34:24.047310 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-c7a81311-2e72-43c0-870e-4bfe32009cb9 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:24.048029 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-c7a81311-2e72-43c0-870e-4bfe32009cb9 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 20c19dcc-7224-44dc-8921-a03017d002d7] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:24.055786 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c7a81311-2e72-43c0-870e-4bfe32009cb9 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:24.056254 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c7a81311-2e72-43c0-870e-4bfe32009cb9 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:24.057223 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c7a81311-2e72-43c0-870e-4bfe32009cb9 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:24.057657 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c7a81311-2e72-43c0-870e-4bfe32009cb9 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:24.087433 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-2ca7f25a-67aa-4c31-b541-fad6976cd01e tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:24.088041 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-2ca7f25a-67aa-4c31-b541-fad6976cd01e tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] [instance: 9dc28a7e-3433-4b18-b45e-9818080b2f7b] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:24.095356 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2ca7f25a-67aa-4c31-b541-fad6976cd01e tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:24.095727 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2ca7f25a-67aa-4c31-b541-fad6976cd01e tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:24.096512 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2ca7f25a-67aa-4c31-b541-fad6976cd01e tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:24.096944 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2ca7f25a-67aa-4c31-b541-fad6976cd01e tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:24.223087 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-c7a81311-2e72-43c0-870e-4bfe32009cb9 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:24.230501 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-c7a81311-2e72-43c0-870e-4bfe32009cb9 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/20c19dcc-7224-44dc-8921-a03017d002d7" status: 200 len: 1513 microversion: 2.1 time: 0.187316 Dec 15 13:34:24.231194 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 305/600] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:24 2021] GET /compute/v2.1/servers/20c19dcc-7224-44dc-8921-a03017d002d7 => generated 1513 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:34:24.278022 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-2ca7f25a-67aa-4c31-b541-fad6976cd01e tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52a2c8071134b07bdc222088246a671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050149bd93864d2abd0b342b8062d3d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:24.285364 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-2ca7f25a-67aa-4c31-b541-fad6976cd01e tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] 10.222.0.60 "GET /compute/v2.1/servers/9dc28a7e-3433-4b18-b45e-9818080b2f7b" status: 200 len: 1502 microversion: 2.1 time: 0.201465 Dec 15 13:34:24.285935 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 296/601] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:24 2021] GET /compute/v2.1/servers/9dc28a7e-3433-4b18-b45e-9818080b2f7b => generated 1502 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:34:24.516504 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-2cd79038-fff9-45b7-9520-78104f2ebdf4 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:24.517546 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-2cd79038-fff9-45b7-9520-78104f2ebdf4 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:24.523784 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2cd79038-fff9-45b7-9520-78104f2ebdf4 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:24.524235 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2cd79038-fff9-45b7-9520-78104f2ebdf4 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:24.525018 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2cd79038-fff9-45b7-9520-78104f2ebdf4 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:24.525452 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2cd79038-fff9-45b7-9520-78104f2ebdf4 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:24.665577 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-c85f0967-ec5b-46cc-8ff3-2eb3a96a73fa tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:24.666723 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-c85f0967-ec5b-46cc-8ff3-2eb3a96a73fa tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:24.673424 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-2cd79038-fff9-45b7-9520-78104f2ebdf4 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 36452 microversion: 2.1 time: 0.161061 Dec 15 13:34:24.677591 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 306/602] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:34:24 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 36452 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:34:24.679502 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c85f0967-ec5b-46cc-8ff3-2eb3a96a73fa tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:24.679948 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c85f0967-ec5b-46cc-8ff3-2eb3a96a73fa tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:24.680730 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c85f0967-ec5b-46cc-8ff3-2eb3a96a73fa tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:24.681156 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c85f0967-ec5b-46cc-8ff3-2eb3a96a73fa tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:24.807903 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-70e9ec41-6258-499f-b1f0-338a08d4a3ce tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:24.809693 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-70e9ec41-6258-499f-b1f0-338a08d4a3ce tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:24.817208 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-70e9ec41-6258-499f-b1f0-338a08d4a3ce tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:24.817738 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-70e9ec41-6258-499f-b1f0-338a08d4a3ce tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:24.818598 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-70e9ec41-6258-499f-b1f0-338a08d4a3ce tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:24.819127 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-70e9ec41-6258-499f-b1f0-338a08d4a3ce tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:24.926861 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-c85f0967-ec5b-46cc-8ff3-2eb3a96a73fa tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 38101 microversion: 2.20 time: 0.264680 Dec 15 13:34:24.927716 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 297/603] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:34:24 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 38101 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:34:24.932334 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-eed2bd2e-aced-4a1a-b429-784d998ce9ef req-7b58bd75-9072-48e7-82a2-cf3a6c807db4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dc28a7e-3433-4b18-b45e-9818080b2f7b", "name": "network-vif-deleted", "tag": "d9f33076-1c2e-4ce1-822b-f66e969079f6"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:24.934396 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:34:24.934396 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: warnings.warn(msg) Dec 15 13:34:24.942266 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-eed2bd2e-aced-4a1a-b429-784d998ce9ef req-7b58bd75-9072-48e7-82a2-cf3a6c807db4 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:24.942951 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-eed2bd2e-aced-4a1a-b429-784d998ce9ef req-7b58bd75-9072-48e7-82a2-cf3a6c807db4 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:24.958539 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-eed2bd2e-aced-4a1a-b429-784d998ce9ef req-7b58bd75-9072-48e7-82a2-cf3a6c807db4 service nova] Creating event network-vif-deleted:d9f33076-1c2e-4ce1-822b-f66e969079f6 for instance 9dc28a7e-3433-4b18-b45e-9818080b2f7b on hv-cinder-81322 Dec 15 13:34:24.965234 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-eed2bd2e-aced-4a1a-b429-784d998ce9ef req-7b58bd75-9072-48e7-82a2-cf3a6c807db4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036011 Dec 15 13:34:24.965908 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 298/604] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:34:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:34:24.970001 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-70e9ec41-6258-499f-b1f0-338a08d4a3ce tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:24.978506 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-70e9ec41-6258-499f-b1f0-338a08d4a3ce tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a" status: 200 len: 1555 microversion: 2.1 time: 0.174819 Dec 15 13:34:24.979382 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 307/605] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:24 2021] GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a => generated 1555 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:34:25.247928 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-c9c84431-0cbd-4a19-8395-97d3494c6c85 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:25.248658 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-c9c84431-0cbd-4a19-8395-97d3494c6c85 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 20c19dcc-7224-44dc-8921-a03017d002d7] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:25.254587 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c9c84431-0cbd-4a19-8395-97d3494c6c85 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:25.255092 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c9c84431-0cbd-4a19-8395-97d3494c6c85 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:25.255874 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c9c84431-0cbd-4a19-8395-97d3494c6c85 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:25.256306 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c9c84431-0cbd-4a19-8395-97d3494c6c85 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:25.302024 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-af043322-5046-4abb-bda9-50011686e315 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:25.302644 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-af043322-5046-4abb-bda9-50011686e315 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] [instance: 9dc28a7e-3433-4b18-b45e-9818080b2f7b] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:25.309185 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-af043322-5046-4abb-bda9-50011686e315 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:25.309638 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-af043322-5046-4abb-bda9-50011686e315 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:25.310426 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-af043322-5046-4abb-bda9-50011686e315 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:25.310887 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-af043322-5046-4abb-bda9-50011686e315 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:25.344387 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-af043322-5046-4abb-bda9-50011686e315 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:25.344857 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-af043322-5046-4abb-bda9-50011686e315 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:25.345381 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.objects.instance [None req-af043322-5046-4abb-bda9-50011686e315 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lazy-loading 'fault' on Instance uuid 9dc28a7e-3433-4b18-b45e-9818080b2f7b {{(pid=116942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:34:25.416016 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-af043322-5046-4abb-bda9-50011686e315 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52a2c8071134b07bdc222088246a671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050149bd93864d2abd0b342b8062d3d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:25.424566 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-af043322-5046-4abb-bda9-50011686e315 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] 10.222.0.60 "GET /compute/v2.1/servers/9dc28a7e-3433-4b18-b45e-9818080b2f7b" status: 200 len: 1303 microversion: 2.1 time: 0.126869 Dec 15 13:34:25.429372 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 308/606] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:25 2021] GET /compute/v2.1/servers/9dc28a7e-3433-4b18-b45e-9818080b2f7b => generated 1303 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:34:25.482536 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-c9c84431-0cbd-4a19-8395-97d3494c6c85 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:25.494101 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-c9c84431-0cbd-4a19-8395-97d3494c6c85 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/20c19dcc-7224-44dc-8921-a03017d002d7" status: 200 len: 1513 microversion: 2.1 time: 0.250456 Dec 15 13:34:25.494737 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 299/607] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:25 2021] GET /compute/v2.1/servers/20c19dcc-7224-44dc-8921-a03017d002d7 => generated 1513 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:34:25.685223 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-41b9d787-3d70-456f-9805-9af1ba1a5834 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:25.686227 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-41b9d787-3d70-456f-9805-9af1ba1a5834 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:25.692518 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-41b9d787-3d70-456f-9805-9af1ba1a5834 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:25.692970 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-41b9d787-3d70-456f-9805-9af1ba1a5834 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:25.693755 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-41b9d787-3d70-456f-9805-9af1ba1a5834 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:25.694192 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-41b9d787-3d70-456f-9805-9af1ba1a5834 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:25.784351 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-41b9d787-3d70-456f-9805-9af1ba1a5834 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 37479 microversion: 2.1 time: 0.102579 Dec 15 13:34:25.784904 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 309/608] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:34:25 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 37479 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:34:25.939211 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-d7e8e18f-7b34-4cb9-a0f4-9526e2561557 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:25.940149 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-d7e8e18f-7b34-4cb9-a0f4-9526e2561557 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:25.946661 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d7e8e18f-7b34-4cb9-a0f4-9526e2561557 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:25.947142 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d7e8e18f-7b34-4cb9-a0f4-9526e2561557 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:25.947922 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d7e8e18f-7b34-4cb9-a0f4-9526e2561557 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:25.948358 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d7e8e18f-7b34-4cb9-a0f4-9526e2561557 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:25.997174 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-aa8ee936-1b55-4e2c-a64f-80585daf6e24 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:25.997871 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-aa8ee936-1b55-4e2c-a64f-80585daf6e24 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:26.004615 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-aa8ee936-1b55-4e2c-a64f-80585daf6e24 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:26.005072 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-aa8ee936-1b55-4e2c-a64f-80585daf6e24 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:26.005855 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-aa8ee936-1b55-4e2c-a64f-80585daf6e24 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:26.006304 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-aa8ee936-1b55-4e2c-a64f-80585daf6e24 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:26.060279 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-d7e8e18f-7b34-4cb9-a0f4-9526e2561557 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 38101 microversion: 2.20 time: 0.124497 Dec 15 13:34:26.061768 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 300/609] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:34:25 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 38101 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:34:26.140303 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-aa8ee936-1b55-4e2c-a64f-80585daf6e24 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:26.148345 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-aa8ee936-1b55-4e2c-a64f-80585daf6e24 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a" status: 200 len: 1555 microversion: 2.1 time: 0.155638 Dec 15 13:34:26.149022 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 310/610] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:25 2021] GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:34:26.446227 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-0c49694d-64cc-4333-8fc3-f6fbb7b7e9f6 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:26.446880 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-0c49694d-64cc-4333-8fc3-f6fbb7b7e9f6 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] [instance: 9dc28a7e-3433-4b18-b45e-9818080b2f7b] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:26.453712 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0c49694d-64cc-4333-8fc3-f6fbb7b7e9f6 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:26.454157 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0c49694d-64cc-4333-8fc3-f6fbb7b7e9f6 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:26.454963 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0c49694d-64cc-4333-8fc3-f6fbb7b7e9f6 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:26.455398 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0c49694d-64cc-4333-8fc3-f6fbb7b7e9f6 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:26.468642 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.wsgi [None req-0c49694d-64cc-4333-8fc3-f6fbb7b7e9f6 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] HTTP exception thrown: Instance 9dc28a7e-3433-4b18-b45e-9818080b2f7b could not be found. Dec 15 13:34:26.469213 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-0c49694d-64cc-4333-8fc3-f6fbb7b7e9f6 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Returning 404 to user: Instance 9dc28a7e-3433-4b18-b45e-9818080b2f7b could not be found. {{(pid=116941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:34:26.470013 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-0c49694d-64cc-4333-8fc3-f6fbb7b7e9f6 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] 10.222.0.60 "GET /compute/v2.1/servers/9dc28a7e-3433-4b18-b45e-9818080b2f7b" status: 404 len: 111 microversion: 2.1 time: 0.028210 Dec 15 13:34:26.470525 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 301/611] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:26 2021] GET /compute/v2.1/servers/9dc28a7e-3433-4b18-b45e-9818080b2f7b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:34:26.510878 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-25b5c813-5216-4022-b5ac-68792b166e96 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:26.511639 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-25b5c813-5216-4022-b5ac-68792b166e96 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 20c19dcc-7224-44dc-8921-a03017d002d7] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:26.517276 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-5efadac1-3062-489c-9aec-347450044cf1 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-456489734", "imageRef": "cfccedbb-7169-47ec-9bae-d4829cba54e1", "flavorRef": "452", "networks": [{"uuid": "4d3a2dfa-2632-456f-8365-44a5206de285"}]}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:26.518302 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-25b5c813-5216-4022-b5ac-68792b166e96 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:26.518755 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-25b5c813-5216-4022-b5ac-68792b166e96 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:26.519568 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-25b5c813-5216-4022-b5ac-68792b166e96 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:26.520005 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-25b5c813-5216-4022-b5ac-68792b166e96 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:26.532938 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.wsgi [None req-25b5c813-5216-4022-b5ac-68792b166e96 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] HTTP exception thrown: Instance 20c19dcc-7224-44dc-8921-a03017d002d7 could not be found. Dec 15 13:34:26.533526 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-25b5c813-5216-4022-b5ac-68792b166e96 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Returning 404 to user: Instance 20c19dcc-7224-44dc-8921-a03017d002d7 could not be found. {{(pid=116942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:34:26.534783 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-25b5c813-5216-4022-b5ac-68792b166e96 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/20c19dcc-7224-44dc-8921-a03017d002d7" status: 404 len: 111 microversion: 2.1 time: 0.027276 Dec 15 13:34:26.535355 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 311/612] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:26 2021] GET /compute/v2.1/servers/20c19dcc-7224-44dc-8921-a03017d002d7 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:34:26.542633 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-8558f6ed-3595-4a68-a387-62c7df5c4b1b tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:26.543668 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-8558f6ed-3595-4a68-a387-62c7df5c4b1b tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: c7690a69-d110-45d1-8a94-2c7c366bba36] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:26.549400 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8558f6ed-3595-4a68-a387-62c7df5c4b1b tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:26.549848 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8558f6ed-3595-4a68-a387-62c7df5c4b1b tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:26.550617 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8558f6ed-3595-4a68-a387-62c7df5c4b1b tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:26.551077 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8558f6ed-3595-4a68-a387-62c7df5c4b1b tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:26.569606 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.network.neutron [None req-5efadac1-3062-489c-9aec-347450044cf1 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] validate_networks() for [('4d3a2dfa-2632-456f-8365-44a5206de285', None, None, None, None, None)] {{(pid=116941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:34:26.575876 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-8558f6ed-3595-4a68-a387-62c7df5c4b1b tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: c7690a69-d110-45d1-8a94-2c7c366bba36] Going to try to terminate instance {{(pid=116942) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:34:26.653587 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-8558f6ed-3595-4a68-a387-62c7df5c4b1b tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c7690a69-d110-45d1-8a94-2c7c366bba36" status: 204 len: 0 microversion: 2.1 time: 0.113890 Dec 15 13:34:26.654192 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 312/613] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Dec 15 13:34:26 2021] DELETE /compute/v2.1/servers/c7690a69-d110-45d1-8a94-2c7c366bba36 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 15 13:34:26.662411 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-dc3c87be-24cd-4429-83bb-40efd548abec tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:26.663216 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-dc3c87be-24cd-4429-83bb-40efd548abec tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: c7690a69-d110-45d1-8a94-2c7c366bba36] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:26.669635 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-dc3c87be-24cd-4429-83bb-40efd548abec tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:26.670550 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-dc3c87be-24cd-4429-83bb-40efd548abec tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:26.670985 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-dc3c87be-24cd-4429-83bb-40efd548abec tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:26.671440 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-dc3c87be-24cd-4429-83bb-40efd548abec tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:26.872313 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:34:26.872587 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: Wed Dec 15 13:34:26 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Dec 15 13:34:26.883033 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-dc3c87be-24cd-4429-83bb-40efd548abec tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:26.891329 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-dc3c87be-24cd-4429-83bb-40efd548abec tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/c7690a69-d110-45d1-8a94-2c7c366bba36" status: 200 len: 1514 microversion: 2.1 time: 0.232875 Dec 15 13:34:26.891905 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 313/614] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:26 2021] GET /compute/v2.1/servers/c7690a69-d110-45d1-8a94-2c7c366bba36 => generated 1514 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:34:26.897145 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-191f2167-04a4-4488-9977-d0fdf7788c03 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:26.898130 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-191f2167-04a4-4488-9977-d0fdf7788c03 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:26.904034 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-191f2167-04a4-4488-9977-d0fdf7788c03 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:26.904568 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-191f2167-04a4-4488-9977-d0fdf7788c03 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:26.905357 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-191f2167-04a4-4488-9977-d0fdf7788c03 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:26.905803 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-191f2167-04a4-4488-9977-d0fdf7788c03 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:26.989675 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-5efadac1-3062-489c-9aec-347450044cf1 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Flavor limits 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:34:26.990115 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-5efadac1-3062-489c-9aec-347450044cf1 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Image limits 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:34:26.990551 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-5efadac1-3062-489c-9aec-347450044cf1 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Flavor pref 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:34:26.991016 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-5efadac1-3062-489c-9aec-347450044cf1 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Image pref 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:34:26.991428 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-5efadac1-3062-489c-9aec-347450044cf1 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:34:27.000896 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5efadac1-3062-489c-9aec-347450044cf1 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:27.001306 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-191f2167-04a4-4488-9977-d0fdf7788c03 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 38127 microversion: 2.1 time: 0.107488 Dec 15 13:34:27.001431 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5efadac1-3062-489c-9aec-347450044cf1 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:27.002197 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 314/615] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:34:26 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 38127 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:34:27.002336 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5efadac1-3062-489c-9aec-347450044cf1 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:27.002565 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5efadac1-3062-489c-9aec-347450044cf1 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:27.007080 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-e984ecb0-cad1-45f2-ba18-384cbdcf06dd req-ba57f8de-1244-4164-8bba-86357bb7fef5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20c19dcc-7224-44dc-8921-a03017d002d7", "name": "network-vif-deleted", "tag": "072e8117-2eea-4cb6-b7bd-92aa00b05e95"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:27.008521 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:34:27.008521 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: warnings.warn(msg) Dec 15 13:34:27.016130 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-e984ecb0-cad1-45f2-ba18-384cbdcf06dd req-ba57f8de-1244-4164-8bba-86357bb7fef5 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:27.016575 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-e984ecb0-cad1-45f2-ba18-384cbdcf06dd req-ba57f8de-1244-4164-8bba-86357bb7fef5 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:27.019813 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-5efadac1-3062-489c-9aec-347450044cf1 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Getting quotas for project 050149bd93864d2abd0b342b8062d3d5. Resources: {'cores', 'instances', 'ram'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:34:27.023724 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-5efadac1-3062-489c-9aec-347450044cf1 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Getting quotas for user a52a2c8071134b07bdc222088246a671 and project 050149bd93864d2abd0b342b8062d3d5. Resources: {'cores', 'instances', 'ram'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:34:27.027058 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-e984ecb0-cad1-45f2-ba18-384cbdcf06dd req-ba57f8de-1244-4164-8bba-86357bb7fef5 service nova] Creating event network-vif-deleted:072e8117-2eea-4cb6-b7bd-92aa00b05e95 for instance 20c19dcc-7224-44dc-8921-a03017d002d7 on hv-cinder-81322 Dec 15 13:34:27.031854 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-e984ecb0-cad1-45f2-ba18-384cbdcf06dd req-ba57f8de-1244-4164-8bba-86357bb7fef5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028434 Dec 15 13:34:27.032539 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 315/616] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:34:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:34:27.035071 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-5efadac1-3062-489c-9aec-347450044cf1 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Going to run 1 instances... {{(pid=116941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:34:27.037480 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-5efadac1-3062-489c-9aec-347450044cf1 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] [instance: 3f44ec57-99c3-454f-950c-0853717a6936] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cfccedbb-7169-47ec-9bae-d4829cba54e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:34:27.073741 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-aaa734d1-3600-4168-964c-a151bd5c28d4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:27.074824 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-aaa734d1-3600-4168-964c-a151bd5c28d4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:27.081746 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-aaa734d1-3600-4168-964c-a151bd5c28d4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:27.082108 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-5efadac1-3062-489c-9aec-347450044cf1 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.568351 Dec 15 13:34:27.082334 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-aaa734d1-3600-4168-964c-a151bd5c28d4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:27.082981 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 302/617] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Dec 15 13:34:26 2021] POST /compute/v2.1/servers => generated 380 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 15 13:34:27.083176 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-aaa734d1-3600-4168-964c-a151bd5c28d4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:27.083583 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-aaa734d1-3600-4168-964c-a151bd5c28d4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:27.092071 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-7bda686d-d4e7-46af-97a0-82a00595d6c2 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:27.092678 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-7bda686d-d4e7-46af-97a0-82a00595d6c2 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] [instance: 3f44ec57-99c3-454f-950c-0853717a6936] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:27.142781 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-7bda686d-d4e7-46af-97a0-82a00595d6c2 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52a2c8071134b07bdc222088246a671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050149bd93864d2abd0b342b8062d3d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:27.149317 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-7bda686d-d4e7-46af-97a0-82a00595d6c2 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] 10.222.0.60 "GET /compute/v2.1/servers/3f44ec57-99c3-454f-950c-0853717a6936" status: 200 len: 1213 microversion: 2.1 time: 0.060753 Dec 15 13:34:27.149886 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 303/618] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:27 2021] GET /compute/v2.1/servers/3f44ec57-99c3-454f-950c-0853717a6936 => generated 1213 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:34:27.164284 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-aaa734d1-3600-4168-964c-a151bd5c28d4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 38101 microversion: 2.20 time: 0.095503 Dec 15 13:34:27.165084 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-face579b-4bcc-4432-859b-fe3bca119d4e tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:27.166010 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-face579b-4bcc-4432-859b-fe3bca119d4e tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:27.169686 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 316/619] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:34:27 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 38101 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:34:27.173112 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-face579b-4bcc-4432-859b-fe3bca119d4e tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:27.173568 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-face579b-4bcc-4432-859b-fe3bca119d4e tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:27.174351 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-face579b-4bcc-4432-859b-fe3bca119d4e tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:27.174790 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-face579b-4bcc-4432-859b-fe3bca119d4e tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:27.305709 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-face579b-4bcc-4432-859b-fe3bca119d4e tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:27.314176 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-face579b-4bcc-4432-859b-fe3bca119d4e tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a" status: 200 len: 1555 microversion: 2.1 time: 0.152565 Dec 15 13:34:27.314758 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 304/620] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:27 2021] GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:34:27.908726 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-dd62e8c5-1845-4d27-b1b0-7bd835b89c8f tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:27.909375 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-dd62e8c5-1845-4d27-b1b0-7bd835b89c8f tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: c7690a69-d110-45d1-8a94-2c7c366bba36] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:27.916163 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-dd62e8c5-1845-4d27-b1b0-7bd835b89c8f tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:27.916610 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-dd62e8c5-1845-4d27-b1b0-7bd835b89c8f tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:27.917382 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-dd62e8c5-1845-4d27-b1b0-7bd835b89c8f tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:27.917851 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-dd62e8c5-1845-4d27-b1b0-7bd835b89c8f tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:28.013571 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-d0ab734f-1ec7-4bd0-aacb-ce90c7de95f1 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:28.014699 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-d0ab734f-1ec7-4bd0-aacb-ce90c7de95f1 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:28.020954 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d0ab734f-1ec7-4bd0-aacb-ce90c7de95f1 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:28.021416 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d0ab734f-1ec7-4bd0-aacb-ce90c7de95f1 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:28.022216 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d0ab734f-1ec7-4bd0-aacb-ce90c7de95f1 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:28.022657 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d0ab734f-1ec7-4bd0-aacb-ce90c7de95f1 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:28.055551 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-dd62e8c5-1845-4d27-b1b0-7bd835b89c8f tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:28.064126 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-dd62e8c5-1845-4d27-b1b0-7bd835b89c8f tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/c7690a69-d110-45d1-8a94-2c7c366bba36" status: 200 len: 1514 microversion: 2.1 time: 0.159465 Dec 15 13:34:28.064707 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 317/621] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:27 2021] GET /compute/v2.1/servers/c7690a69-d110-45d1-8a94-2c7c366bba36 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:34:28.117671 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-d0ab734f-1ec7-4bd0-aacb-ce90c7de95f1 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 38127 microversion: 2.1 time: 0.108125 Dec 15 13:34:28.119127 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 305/622] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:34:28 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 38127 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:34:28.165498 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-6e214149-8e29-49bf-9865-bed0e9d53ed3 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:28.166024 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-6e214149-8e29-49bf-9865-bed0e9d53ed3 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] [instance: 3f44ec57-99c3-454f-950c-0853717a6936] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:28.177219 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-48fe8962-5ced-4ae9-895d-de36ad307cb6 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:28.178211 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-48fe8962-5ced-4ae9-895d-de36ad307cb6 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:28.183823 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6e214149-8e29-49bf-9865-bed0e9d53ed3 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:28.184281 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6e214149-8e29-49bf-9865-bed0e9d53ed3 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:28.185078 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6e214149-8e29-49bf-9865-bed0e9d53ed3 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:28.185514 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6e214149-8e29-49bf-9865-bed0e9d53ed3 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:28.191961 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-48fe8962-5ced-4ae9-895d-de36ad307cb6 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:28.192411 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-48fe8962-5ced-4ae9-895d-de36ad307cb6 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:28.193207 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-48fe8962-5ced-4ae9-895d-de36ad307cb6 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:28.193639 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-48fe8962-5ced-4ae9-895d-de36ad307cb6 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:28.260007 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-6e214149-8e29-49bf-9865-bed0e9d53ed3 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52a2c8071134b07bdc222088246a671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050149bd93864d2abd0b342b8062d3d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:28.268696 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-6e214149-8e29-49bf-9865-bed0e9d53ed3 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] 10.222.0.60 "GET /compute/v2.1/servers/3f44ec57-99c3-454f-950c-0853717a6936" status: 200 len: 1283 microversion: 2.1 time: 0.106510 Dec 15 13:34:28.268802 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 318/623] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:28 2021] GET /compute/v2.1/servers/3f44ec57-99c3-454f-950c-0853717a6936 => generated 1283 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:34:28.310438 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-48fe8962-5ced-4ae9-895d-de36ad307cb6 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 200 len: 38242 microversion: 2.20 time: 0.136927 Dec 15 13:34:28.314736 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 306/624] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:34:28 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 38242 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:34:28.320916 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-bbf54a94-bae1-4972-88f2-fdbdc3dfa3f1 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:28.321482 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-bbf54a94-bae1-4972-88f2-fdbdc3dfa3f1 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:28.329574 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-bbf54a94-bae1-4972-88f2-fdbdc3dfa3f1 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:28.330099 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-bbf54a94-bae1-4972-88f2-fdbdc3dfa3f1 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:28.331062 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-bbf54a94-bae1-4972-88f2-fdbdc3dfa3f1 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:28.331568 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-bbf54a94-bae1-4972-88f2-fdbdc3dfa3f1 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:28.331853 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-1e045721-073d-4e5a-a12d-78ecceb5bf43 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:28.332703 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-1e045721-073d-4e5a-a12d-78ecceb5bf43 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:28.339760 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1e045721-073d-4e5a-a12d-78ecceb5bf43 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:28.340442 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1e045721-073d-4e5a-a12d-78ecceb5bf43 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:28.341057 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1e045721-073d-4e5a-a12d-78ecceb5bf43 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:28.341500 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1e045721-073d-4e5a-a12d-78ecceb5bf43 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:28.357698 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-bbf54a94-bae1-4972-88f2-fdbdc3dfa3f1 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/ips" status: 200 len: 152 microversion: 2.20 time: 0.040580 Dec 15 13:34:28.358493 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 319/625] 10.222.0.60 () {60 vars in 1288 bytes} [Wed Dec 15 13:34:28 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/ips => generated 152 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:34:28.488299 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-1e045721-073d-4e5a-a12d-78ecceb5bf43 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:28.497364 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-1e045721-073d-4e5a-a12d-78ecceb5bf43 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a" status: 200 len: 1561 microversion: 2.1 time: 0.169630 Dec 15 13:34:28.497956 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 307/626] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:28 2021] GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a => generated 1561 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:34:28.570349 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ade26441-3629-4468-aa1e-b488fd690b48 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:28.570951 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ade26441-3629-4468-aa1e-b488fd690b48 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:28.577608 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ade26441-3629-4468-aa1e-b488fd690b48 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:28.578179 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ade26441-3629-4468-aa1e-b488fd690b48 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:28.579290 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ade26441-3629-4468-aa1e-b488fd690b48 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:28.579648 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ade26441-3629-4468-aa1e-b488fd690b48 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:28.677763 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.objects.instance [None req-ade26441-3629-4468-aa1e-b488fd690b48 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lazy-loading 'services' on Instance uuid eab2a5ce-9a56-4120-ae3c-ddfb844aa30a {{(pid=116942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:34:28.755864 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ade26441-3629-4468-aa1e-b488fd690b48 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "DELETE /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a/os-volume_attachments/12c3c743-9c46-452e-b4d2-b91656962919" status: 202 len: 0 microversion: 2.1 time: 0.189894 Dec 15 13:34:28.756590 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 320/627] 10.222.0.60 () {58 vars in 1415 bytes} [Wed Dec 15 13:34:28 2021] DELETE /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a/os-volume_attachments/12c3c743-9c46-452e-b4d2-b91656962919 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:34:28.767594 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-7acf4d70-bd72-41c6-94c5-e7767e69e96b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:28.772504 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-7acf4d70-bd72-41c6-94c5-e7767e69e96b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:28.779677 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7acf4d70-bd72-41c6-94c5-e7767e69e96b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:28.780607 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7acf4d70-bd72-41c6-94c5-e7767e69e96b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:28.781316 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7acf4d70-bd72-41c6-94c5-e7767e69e96b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:28.781828 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7acf4d70-bd72-41c6-94c5-e7767e69e96b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:28.815207 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-7acf4d70-bd72-41c6-94c5-e7767e69e96b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053975 Dec 15 13:34:28.815782 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 308/628] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Dec 15 13:34:28 2021] GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:34:29.081749 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-bc50d9a5-f163-4f56-860f-50efb7e59f7c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:29.082487 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-bc50d9a5-f163-4f56-860f-50efb7e59f7c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: c7690a69-d110-45d1-8a94-2c7c366bba36] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:29.088702 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-bc50d9a5-f163-4f56-860f-50efb7e59f7c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:29.089161 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-bc50d9a5-f163-4f56-860f-50efb7e59f7c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:29.090452 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-bc50d9a5-f163-4f56-860f-50efb7e59f7c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:29.090934 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-bc50d9a5-f163-4f56-860f-50efb7e59f7c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:29.129256 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-435acc9e-f51d-48c9-8db8-48214368ed28 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:29.130605 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-435acc9e-f51d-48c9-8db8-48214368ed28 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:29.136811 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-435acc9e-f51d-48c9-8db8-48214368ed28 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:29.137259 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-435acc9e-f51d-48c9-8db8-48214368ed28 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:29.138086 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-435acc9e-f51d-48c9-8db8-48214368ed28 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:29.138522 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-435acc9e-f51d-48c9-8db8-48214368ed28 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:29.224913 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-bc50d9a5-f163-4f56-860f-50efb7e59f7c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:29.232242 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-bc50d9a5-f163-4f56-860f-50efb7e59f7c tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/c7690a69-d110-45d1-8a94-2c7c366bba36" status: 200 len: 1514 microversion: 2.1 time: 0.154693 Dec 15 13:34:29.232809 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 321/629] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:29 2021] GET /compute/v2.1/servers/c7690a69-d110-45d1-8a94-2c7c366bba36 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:34:29.285179 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-67b3e6a7-6d88-447e-bc00-03f853c85037 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:29.285791 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-67b3e6a7-6d88-447e-bc00-03f853c85037 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] [instance: 3f44ec57-99c3-454f-950c-0853717a6936] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:29.291512 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-67b3e6a7-6d88-447e-bc00-03f853c85037 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:29.291970 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-67b3e6a7-6d88-447e-bc00-03f853c85037 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:29.292775 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-67b3e6a7-6d88-447e-bc00-03f853c85037 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:29.293208 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-67b3e6a7-6d88-447e-bc00-03f853c85037 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:29.336249 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-435acc9e-f51d-48c9-8db8-48214368ed28 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 38127 microversion: 2.1 time: 0.210347 Dec 15 13:34:29.337364 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 309/630] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:34:29 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 38127 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:34:29.427579 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-67b3e6a7-6d88-447e-bc00-03f853c85037 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52a2c8071134b07bdc222088246a671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050149bd93864d2abd0b342b8062d3d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:29.434825 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-67b3e6a7-6d88-447e-bc00-03f853c85037 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] 10.222.0.60 "GET /compute/v2.1/servers/3f44ec57-99c3-454f-950c-0853717a6936" status: 200 len: 1313 microversion: 2.1 time: 0.153251 Dec 15 13:34:29.435420 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 322/631] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:29 2021] GET /compute/v2.1/servers/3f44ec57-99c3-454f-950c-0853717a6936 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:34:29.700981 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-e6f85103-a1b4-4ebe-97e3-52aae43ce090 req-1acda1ad-f334-42c0-a556-24bc167b7339 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7690a69-d110-45d1-8a94-2c7c366bba36", "name": "network-vif-deleted", "tag": "92df63b2-2815-4499-b41a-e23801cf68f8"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:29.702522 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:34:29.702522 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: warnings.warn(msg) Dec 15 13:34:29.737845 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-e6f85103-a1b4-4ebe-97e3-52aae43ce090 req-1acda1ad-f334-42c0-a556-24bc167b7339 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:29.738255 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-e6f85103-a1b4-4ebe-97e3-52aae43ce090 req-1acda1ad-f334-42c0-a556-24bc167b7339 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:29.751652 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-e6f85103-a1b4-4ebe-97e3-52aae43ce090 req-1acda1ad-f334-42c0-a556-24bc167b7339 service nova] Creating event network-vif-deleted:92df63b2-2815-4499-b41a-e23801cf68f8 for instance c7690a69-d110-45d1-8a94-2c7c366bba36 on hv-cinder-81322 Dec 15 13:34:29.760222 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-e6f85103-a1b4-4ebe-97e3-52aae43ce090 req-1acda1ad-f334-42c0-a556-24bc167b7339 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067628 Dec 15 13:34:29.761145 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 310/632] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:34:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:34:29.827747 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-b24f182d-a1f3-4190-8788-691acecf4dd9 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:29.828802 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-b24f182d-a1f3-4190-8788-691acecf4dd9 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:29.834701 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b24f182d-a1f3-4190-8788-691acecf4dd9 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:29.835218 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b24f182d-a1f3-4190-8788-691acecf4dd9 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:29.836037 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b24f182d-a1f3-4190-8788-691acecf4dd9 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:29.836476 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b24f182d-a1f3-4190-8788-691acecf4dd9 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:29.873329 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-b24f182d-a1f3-4190-8788-691acecf4dd9 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049913 Dec 15 13:34:29.873907 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 323/633] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Dec 15 13:34:29 2021] GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:34:30.250295 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-5f2526c7-0c33-4153-a202-8080414bfa8e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:30.251763 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-5f2526c7-0c33-4153-a202-8080414bfa8e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: c7690a69-d110-45d1-8a94-2c7c366bba36] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:30.259465 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5f2526c7-0c33-4153-a202-8080414bfa8e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:30.260170 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5f2526c7-0c33-4153-a202-8080414bfa8e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:30.261089 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5f2526c7-0c33-4153-a202-8080414bfa8e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:30.261689 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5f2526c7-0c33-4153-a202-8080414bfa8e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:30.276514 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.wsgi [None req-5f2526c7-0c33-4153-a202-8080414bfa8e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] HTTP exception thrown: Instance c7690a69-d110-45d1-8a94-2c7c366bba36 could not be found. Dec 15 13:34:30.277238 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-5f2526c7-0c33-4153-a202-8080414bfa8e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Returning 404 to user: Instance c7690a69-d110-45d1-8a94-2c7c366bba36 could not be found. {{(pid=116941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:34:30.278323 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-5f2526c7-0c33-4153-a202-8080414bfa8e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/c7690a69-d110-45d1-8a94-2c7c366bba36" status: 404 len: 111 microversion: 2.1 time: 0.033105 Dec 15 13:34:30.281804 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 311/634] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:30 2021] GET /compute/v2.1/servers/c7690a69-d110-45d1-8a94-2c7c366bba36 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:34:30.350531 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-e1520fed-b072-4003-80fe-b63368a51081 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:30.351531 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-e1520fed-b072-4003-80fe-b63368a51081 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:30.361470 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e1520fed-b072-4003-80fe-b63368a51081 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:30.361974 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e1520fed-b072-4003-80fe-b63368a51081 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:30.362733 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e1520fed-b072-4003-80fe-b63368a51081 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:30.363246 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e1520fed-b072-4003-80fe-b63368a51081 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:30.428369 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-e1520fed-b072-4003-80fe-b63368a51081 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 38127 microversion: 2.1 time: 0.083121 Dec 15 13:34:30.429222 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 324/635] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:34:30 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 38127 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:34:30.452182 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-9d6ca377-e20b-4df0-afc3-20f59d2fe4e5 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:30.452805 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-9d6ca377-e20b-4df0-afc3-20f59d2fe4e5 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] [instance: 3f44ec57-99c3-454f-950c-0853717a6936] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:30.459224 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9d6ca377-e20b-4df0-afc3-20f59d2fe4e5 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:30.459672 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9d6ca377-e20b-4df0-afc3-20f59d2fe4e5 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:30.460468 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9d6ca377-e20b-4df0-afc3-20f59d2fe4e5 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:30.460904 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9d6ca377-e20b-4df0-afc3-20f59d2fe4e5 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:30.594362 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-9d6ca377-e20b-4df0-afc3-20f59d2fe4e5 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52a2c8071134b07bdc222088246a671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050149bd93864d2abd0b342b8062d3d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:30.601570 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-9d6ca377-e20b-4df0-afc3-20f59d2fe4e5 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] 10.222.0.60 "GET /compute/v2.1/servers/3f44ec57-99c3-454f-950c-0853717a6936" status: 200 len: 1313 microversion: 2.1 time: 0.153704 Dec 15 13:34:30.602131 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 312/636] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:30 2021] GET /compute/v2.1/servers/3f44ec57-99c3-454f-950c-0853717a6936 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:34:30.878336 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-5f247aff-129d-4510-a392-4db5f39011f3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:30.878988 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-5f247aff-129d-4510-a392-4db5f39011f3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:30.885779 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5f247aff-129d-4510-a392-4db5f39011f3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:30.886236 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5f247aff-129d-4510-a392-4db5f39011f3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:30.887055 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5f247aff-129d-4510-a392-4db5f39011f3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:30.887497 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5f247aff-129d-4510-a392-4db5f39011f3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:30.910135 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.objects.instance [None req-5f247aff-129d-4510-a392-4db5f39011f3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lazy-loading 'flavor' on Instance uuid 00671676-47cb-4266-b9e5-61c7fb120355 {{(pid=116942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:34:31.169961 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-5f247aff-129d-4510-a392-4db5f39011f3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 202 len: 0 microversion: 2.20 time: 0.295622 Dec 15 13:34:31.170652 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 325/637] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:34:30 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:34:31.178513 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-c3a97c3a-148a-4cd9-a3dc-3e003bafe6d0 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:31.179306 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-c3a97c3a-148a-4cd9-a3dc-3e003bafe6d0 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:31.185690 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c3a97c3a-148a-4cd9-a3dc-3e003bafe6d0 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:31.186171 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c3a97c3a-148a-4cd9-a3dc-3e003bafe6d0 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:31.186957 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c3a97c3a-148a-4cd9-a3dc-3e003bafe6d0 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:31.187416 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c3a97c3a-148a-4cd9-a3dc-3e003bafe6d0 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:31.321735 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-c3a97c3a-148a-4cd9-a3dc-3e003bafe6d0 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:31.333808 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-c3a97c3a-148a-4cd9-a3dc-3e003bafe6d0 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:31.335474 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-c3a97c3a-148a-4cd9-a3dc-3e003bafe6d0 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:31.336861 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-c3a97c3a-148a-4cd9-a3dc-3e003bafe6d0 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1724 microversion: 2.20 time: 0.161943 Dec 15 13:34:31.337539 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 313/638] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:34:31 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:34:31.441763 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-aa70e9f8-f69d-4699-99db-c1bfb7789775 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:31.442753 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-aa70e9f8-f69d-4699-99db-c1bfb7789775 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:31.449818 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-aa70e9f8-f69d-4699-99db-c1bfb7789775 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:31.450272 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-aa70e9f8-f69d-4699-99db-c1bfb7789775 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:31.451091 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-aa70e9f8-f69d-4699-99db-c1bfb7789775 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:31.451535 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-aa70e9f8-f69d-4699-99db-c1bfb7789775 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:31.572621 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-65fe423a-a696-43b6-b979-f6275b136041 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:31.573118 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-65fe423a-a696-43b6-b979-f6275b136041 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 10dd91a3-b40e-4ac3-ac2c-63624e87cf93] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:31.579834 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-65fe423a-a696-43b6-b979-f6275b136041 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:31.580280 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-65fe423a-a696-43b6-b979-f6275b136041 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:31.581045 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-65fe423a-a696-43b6-b979-f6275b136041 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:31.581474 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-65fe423a-a696-43b6-b979-f6275b136041 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:31.605337 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-65fe423a-a696-43b6-b979-f6275b136041 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 10dd91a3-b40e-4ac3-ac2c-63624e87cf93] Going to try to terminate instance {{(pid=116941) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:34:31.647996 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-aa70e9f8-f69d-4699-99db-c1bfb7789775 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 200 len: 38258 microversion: 2.1 time: 0.210547 Dec 15 13:34:31.648662 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 326/639] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:34:31 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 38258 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:34:31.660808 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-2e3ba45a-d191-445c-95d0-a78e1ac8f5e5 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:31.661545 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-2e3ba45a-d191-445c-95d0-a78e1ac8f5e5 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] [instance: 3f44ec57-99c3-454f-950c-0853717a6936] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:31.668769 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2e3ba45a-d191-445c-95d0-a78e1ac8f5e5 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:31.669225 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2e3ba45a-d191-445c-95d0-a78e1ac8f5e5 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:31.670048 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2e3ba45a-d191-445c-95d0-a78e1ac8f5e5 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:31.670508 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2e3ba45a-d191-445c-95d0-a78e1ac8f5e5 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:31.681727 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-65fe423a-a696-43b6-b979-f6275b136041 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "DELETE /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93" status: 204 len: 0 microversion: 2.1 time: 0.112527 Dec 15 13:34:31.685438 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 314/640] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Dec 15 13:34:31 2021] DELETE /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:34:31.688435 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-9137d758-48e0-45cf-ad89-694dfdc21b27 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:31.689025 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-9137d758-48e0-45cf-ad89-694dfdc21b27 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:31.695371 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9137d758-48e0-45cf-ad89-694dfdc21b27 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:31.695856 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9137d758-48e0-45cf-ad89-694dfdc21b27 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:31.696677 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9137d758-48e0-45cf-ad89-694dfdc21b27 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:31.697117 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9137d758-48e0-45cf-ad89-694dfdc21b27 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:31.721460 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-9137d758-48e0-45cf-ad89-694dfdc21b27 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/ips" status: 200 len: 145 microversion: 2.1 time: 0.037616 Dec 15 13:34:31.722061 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 315/641] 10.222.0.60 () {58 vars in 1247 bytes} [Wed Dec 15 13:34:31 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:34:31.726295 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-820beae7-2a1c-48f4-b8c3-a2210241da85 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:31.726993 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-820beae7-2a1c-48f4-b8c3-a2210241da85 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 10dd91a3-b40e-4ac3-ac2c-63624e87cf93] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:31.732710 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-820beae7-2a1c-48f4-b8c3-a2210241da85 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:31.733164 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-820beae7-2a1c-48f4-b8c3-a2210241da85 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:31.733941 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-820beae7-2a1c-48f4-b8c3-a2210241da85 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:31.734378 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-820beae7-2a1c-48f4-b8c3-a2210241da85 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:31.843889 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-2e3ba45a-d191-445c-95d0-a78e1ac8f5e5 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52a2c8071134b07bdc222088246a671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050149bd93864d2abd0b342b8062d3d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:31.851139 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-2e3ba45a-d191-445c-95d0-a78e1ac8f5e5 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] 10.222.0.60 "GET /compute/v2.1/servers/3f44ec57-99c3-454f-950c-0853717a6936" status: 200 len: 1313 microversion: 2.1 time: 0.201315 Dec 15 13:34:31.851716 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 327/642] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:31 2021] GET /compute/v2.1/servers/3f44ec57-99c3-454f-950c-0853717a6936 => generated 1313 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:34:31.856082 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-aee9316e-ef03-4428-880a-770e22b1418a req-1484ae08-0b80-4dbe-9ff7-5ff6a14105cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f44ec57-99c3-454f-950c-0853717a6936", "tag": "63bb9e73-2fd7-4bda-8420-d10b1586e472"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:31.857580 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:34:31.857580 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: warnings.warn(msg) Dec 15 13:34:31.865022 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-aee9316e-ef03-4428-880a-770e22b1418a req-1484ae08-0b80-4dbe-9ff7-5ff6a14105cd service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:31.865471 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-aee9316e-ef03-4428-880a-770e22b1418a req-1484ae08-0b80-4dbe-9ff7-5ff6a14105cd service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:31.876736 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-aee9316e-ef03-4428-880a-770e22b1418a req-1484ae08-0b80-4dbe-9ff7-5ff6a14105cd service nova] Creating event network-changed:63bb9e73-2fd7-4bda-8420-d10b1586e472 for instance 3f44ec57-99c3-454f-950c-0853717a6936 on hv-cinder-81322 Dec 15 13:34:31.881549 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-aee9316e-ef03-4428-880a-770e22b1418a req-1484ae08-0b80-4dbe-9ff7-5ff6a14105cd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028732 Dec 15 13:34:31.882457 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 328/643] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:34:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:34:31.903235 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-820beae7-2a1c-48f4-b8c3-a2210241da85 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:31.910818 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-820beae7-2a1c-48f4-b8c3-a2210241da85 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93" status: 200 len: 1514 microversion: 2.1 time: 0.187823 Dec 15 13:34:31.911404 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 316/644] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:31 2021] GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93 => generated 1514 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:34:32.195292 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ba005cba-01ed-4d88-b400-383ba1b905eb tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:32.195984 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ba005cba-01ed-4d88-b400-383ba1b905eb tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: d3c2da8c-7e29-48ac-9077-59bffb2c734b] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:32.201936 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ba005cba-01ed-4d88-b400-383ba1b905eb tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:32.202385 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ba005cba-01ed-4d88-b400-383ba1b905eb tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:32.203190 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ba005cba-01ed-4d88-b400-383ba1b905eb tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:32.203628 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ba005cba-01ed-4d88-b400-383ba1b905eb tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:32.227299 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ba005cba-01ed-4d88-b400-383ba1b905eb tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: d3c2da8c-7e29-48ac-9077-59bffb2c734b] Going to try to terminate instance {{(pid=116942) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:34:32.306641 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ba005cba-01ed-4d88-b400-383ba1b905eb tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b" status: 204 len: 0 microversion: 2.1 time: 0.115929 Dec 15 13:34:32.307458 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 329/645] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Dec 15 13:34:32 2021] DELETE /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:34:32.316429 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-502698af-36f4-4c3d-ba81-c89669c49de0 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:32.317061 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-502698af-36f4-4c3d-ba81-c89669c49de0 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: d3c2da8c-7e29-48ac-9077-59bffb2c734b] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:32.323621 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-502698af-36f4-4c3d-ba81-c89669c49de0 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:32.324212 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-502698af-36f4-4c3d-ba81-c89669c49de0 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:32.324877 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-502698af-36f4-4c3d-ba81-c89669c49de0 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:32.325314 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-502698af-36f4-4c3d-ba81-c89669c49de0 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:32.358744 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-9de9cf67-0dd8-4690-9f27-a0365e14549b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:32.359189 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-9de9cf67-0dd8-4690-9f27-a0365e14549b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:32.366171 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9de9cf67-0dd8-4690-9f27-a0365e14549b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:32.366707 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9de9cf67-0dd8-4690-9f27-a0365e14549b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:32.367962 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9de9cf67-0dd8-4690-9f27-a0365e14549b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:32.372161 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9de9cf67-0dd8-4690-9f27-a0365e14549b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:32.495436 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-502698af-36f4-4c3d-ba81-c89669c49de0 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:32.503564 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-502698af-36f4-4c3d-ba81-c89669c49de0 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b" status: 200 len: 1508 microversion: 2.1 time: 0.190976 Dec 15 13:34:32.504166 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 317/646] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:32 2021] GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b => generated 1508 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:34:32.539913 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-9de9cf67-0dd8-4690-9f27-a0365e14549b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:32.548063 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-9de9cf67-0dd8-4690-9f27-a0365e14549b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:32.549554 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-9de9cf67-0dd8-4690-9f27-a0365e14549b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:32.550693 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-9de9cf67-0dd8-4690-9f27-a0365e14549b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1724 microversion: 2.20 time: 0.197545 Dec 15 13:34:32.551302 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 330/647] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:34:32 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:34:32.867831 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-012ff50a-f047-4801-a729-c2bdc9a6d9e4 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:32.868455 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-012ff50a-f047-4801-a729-c2bdc9a6d9e4 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] [instance: 3f44ec57-99c3-454f-950c-0853717a6936] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:32.874256 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-012ff50a-f047-4801-a729-c2bdc9a6d9e4 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:32.874786 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-012ff50a-f047-4801-a729-c2bdc9a6d9e4 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:32.875630 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-012ff50a-f047-4801-a729-c2bdc9a6d9e4 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:32.876076 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-012ff50a-f047-4801-a729-c2bdc9a6d9e4 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:32.927406 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-702c9d8f-6759-44e0-b7d8-ae7f2628e4dc tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:32.927938 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-702c9d8f-6759-44e0-b7d8-ae7f2628e4dc tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 10dd91a3-b40e-4ac3-ac2c-63624e87cf93] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:32.933705 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-702c9d8f-6759-44e0-b7d8-ae7f2628e4dc tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:32.934154 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-702c9d8f-6759-44e0-b7d8-ae7f2628e4dc tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:32.934997 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-702c9d8f-6759-44e0-b7d8-ae7f2628e4dc tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:32.935432 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-702c9d8f-6759-44e0-b7d8-ae7f2628e4dc tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:33.067594 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-012ff50a-f047-4801-a729-c2bdc9a6d9e4 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52a2c8071134b07bdc222088246a671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050149bd93864d2abd0b342b8062d3d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:33.075995 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-012ff50a-f047-4801-a729-c2bdc9a6d9e4 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] 10.222.0.60 "GET /compute/v2.1/servers/3f44ec57-99c3-454f-950c-0853717a6936" status: 200 len: 1313 microversion: 2.1 time: 0.211883 Dec 15 13:34:33.076573 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 318/648] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:32 2021] GET /compute/v2.1/servers/3f44ec57-99c3-454f-950c-0853717a6936 => generated 1313 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:34:33.113022 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-702c9d8f-6759-44e0-b7d8-ae7f2628e4dc tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:33.120542 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-702c9d8f-6759-44e0-b7d8-ae7f2628e4dc tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93" status: 200 len: 1514 microversion: 2.1 time: 0.196790 Dec 15 13:34:33.121129 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 331/649] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:32 2021] GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93 => generated 1514 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:34:33.520413 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-9d274856-d4cc-4630-ad49-2b9cb798436d tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:33.521030 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-9d274856-d4cc-4630-ad49-2b9cb798436d tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: d3c2da8c-7e29-48ac-9077-59bffb2c734b] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:33.527292 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9d274856-d4cc-4630-ad49-2b9cb798436d tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:33.527746 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9d274856-d4cc-4630-ad49-2b9cb798436d tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:33.528530 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9d274856-d4cc-4630-ad49-2b9cb798436d tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:33.528970 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9d274856-d4cc-4630-ad49-2b9cb798436d tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:33.569296 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-8abee55e-f0fc-4ad0-9ad2-4ae48266042b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:33.570305 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-8abee55e-f0fc-4ad0-9ad2-4ae48266042b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:33.577023 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8abee55e-f0fc-4ad0-9ad2-4ae48266042b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:33.577476 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8abee55e-f0fc-4ad0-9ad2-4ae48266042b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:33.578265 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8abee55e-f0fc-4ad0-9ad2-4ae48266042b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:33.578704 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8abee55e-f0fc-4ad0-9ad2-4ae48266042b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:33.698531 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-9d274856-d4cc-4630-ad49-2b9cb798436d tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:33.705951 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-9d274856-d4cc-4630-ad49-2b9cb798436d tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b" status: 200 len: 1508 microversion: 2.1 time: 0.189306 Dec 15 13:34:33.706530 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 319/650] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:33 2021] GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b => generated 1508 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:34:33.741694 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-8abee55e-f0fc-4ad0-9ad2-4ae48266042b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:33.750882 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-8abee55e-f0fc-4ad0-9ad2-4ae48266042b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:33.752544 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-8abee55e-f0fc-4ad0-9ad2-4ae48266042b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:33.753709 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-8abee55e-f0fc-4ad0-9ad2-4ae48266042b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1724 microversion: 2.20 time: 0.188172 Dec 15 13:34:33.754273 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 332/651] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:34:33 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:34:34.056097 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-9be939cf-00cb-43ed-bb70-5909adc95b4a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8825dbd9-17d8-4825-9b4e-5f1b7f6b9b66"}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:34.057220 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-9be939cf-00cb-43ed-bb70-5909adc95b4a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:34.063876 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9be939cf-00cb-43ed-bb70-5909adc95b4a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:34.064321 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9be939cf-00cb-43ed-bb70-5909adc95b4a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:34.065098 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9be939cf-00cb-43ed-bb70-5909adc95b4a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:34.065533 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9be939cf-00cb-43ed-bb70-5909adc95b4a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:34.092761 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-7ac58a0c-b4b8-41bd-81ff-35badc264b7d tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:34.093373 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-7ac58a0c-b4b8-41bd-81ff-35badc264b7d tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] [instance: 3f44ec57-99c3-454f-950c-0853717a6936] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:34.101092 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7ac58a0c-b4b8-41bd-81ff-35badc264b7d tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:34.101566 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7ac58a0c-b4b8-41bd-81ff-35badc264b7d tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:34.102348 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7ac58a0c-b4b8-41bd-81ff-35badc264b7d tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:34.102781 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7ac58a0c-b4b8-41bd-81ff-35badc264b7d tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:34.250028 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-7ac58a0c-b4b8-41bd-81ff-35badc264b7d tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52a2c8071134b07bdc222088246a671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050149bd93864d2abd0b342b8062d3d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:34.258231 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-7ac58a0c-b4b8-41bd-81ff-35badc264b7d tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] 10.222.0.60 "GET /compute/v2.1/servers/3f44ec57-99c3-454f-950c-0853717a6936" status: 200 len: 1313 microversion: 2.1 time: 0.169406 Dec 15 13:34:34.258975 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 333/652] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:34 2021] GET /compute/v2.1/servers/3f44ec57-99c3-454f-950c-0853717a6936 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:34:34.263714 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-42d0a009-8efe-4c27-8793-68371d19832e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:34.264333 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-42d0a009-8efe-4c27-8793-68371d19832e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 10dd91a3-b40e-4ac3-ac2c-63624e87cf93] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:34.271837 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-42d0a009-8efe-4c27-8793-68371d19832e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:34.272372 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-42d0a009-8efe-4c27-8793-68371d19832e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:34.273276 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-42d0a009-8efe-4c27-8793-68371d19832e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:34.273722 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-42d0a009-8efe-4c27-8793-68371d19832e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:34.326475 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-9be939cf-00cb-43ed-bb70-5909adc95b4a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274045 Dec 15 13:34:34.327335 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 320/653] 10.222.0.60 () {60 vars in 1322 bytes} [Wed Dec 15 13:34:34 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:34:34.434722 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-42d0a009-8efe-4c27-8793-68371d19832e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df94523ab7c545f2a17a2cafe936d2ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c80dfcc63a49f7b54f89f08cd8842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:34.453807 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-42d0a009-8efe-4c27-8793-68371d19832e tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93" status: 200 len: 1514 microversion: 2.1 time: 0.193279 Dec 15 13:34:34.453979 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 334/654] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:34 2021] GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93 => generated 1514 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:34:34.508273 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-455b8118-a401-4528-8a92-4cf07ca3a0cc req-9bcb471d-f30e-430e-81f9-300c3517c43c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10dd91a3-b40e-4ac3-ac2c-63624e87cf93", "name": "network-vif-deleted", "tag": "3c89bced-e266-4c30-8918-8d80f7f8660a"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:34.510436 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:34:34.510436 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: warnings.warn(msg) Dec 15 13:34:34.518327 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-455b8118-a401-4528-8a92-4cf07ca3a0cc req-9bcb471d-f30e-430e-81f9-300c3517c43c service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:34.518780 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-455b8118-a401-4528-8a92-4cf07ca3a0cc req-9bcb471d-f30e-430e-81f9-300c3517c43c service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:34.532591 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-455b8118-a401-4528-8a92-4cf07ca3a0cc req-9bcb471d-f30e-430e-81f9-300c3517c43c service nova] Creating event network-vif-deleted:3c89bced-e266-4c30-8918-8d80f7f8660a for instance 10dd91a3-b40e-4ac3-ac2c-63624e87cf93 on hv-cinder-81322 Dec 15 13:34:34.537219 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-455b8118-a401-4528-8a92-4cf07ca3a0cc req-9bcb471d-f30e-430e-81f9-300c3517c43c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034803 Dec 15 13:34:34.537833 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 321/655] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:34:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:34:34.722697 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-28a80bc7-4f5b-491a-9266-f71aabd44f2a tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:34.723334 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-28a80bc7-4f5b-491a-9266-f71aabd44f2a tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: d3c2da8c-7e29-48ac-9077-59bffb2c734b] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:34.729115 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-28a80bc7-4f5b-491a-9266-f71aabd44f2a tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:34.729565 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-28a80bc7-4f5b-491a-9266-f71aabd44f2a tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:34.730794 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-28a80bc7-4f5b-491a-9266-f71aabd44f2a tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:34.731261 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-28a80bc7-4f5b-491a-9266-f71aabd44f2a tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:34.772962 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-1f06567d-6f2e-4e5d-b799-6883d0df5e0a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:34.773565 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-1f06567d-6f2e-4e5d-b799-6883d0df5e0a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:34.780161 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1f06567d-6f2e-4e5d-b799-6883d0df5e0a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:34.780617 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1f06567d-6f2e-4e5d-b799-6883d0df5e0a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:34.781412 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1f06567d-6f2e-4e5d-b799-6883d0df5e0a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:34.781852 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1f06567d-6f2e-4e5d-b799-6883d0df5e0a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:34.904986 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-28a80bc7-4f5b-491a-9266-f71aabd44f2a tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:34.913400 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-28a80bc7-4f5b-491a-9266-f71aabd44f2a tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b" status: 200 len: 1508 microversion: 2.1 time: 0.194406 Dec 15 13:34:34.924078 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 335/656] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:34 2021] GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b => generated 1508 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:34:34.960788 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-1f06567d-6f2e-4e5d-b799-6883d0df5e0a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:34.971199 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-1f06567d-6f2e-4e5d-b799-6883d0df5e0a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:34.972848 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-1f06567d-6f2e-4e5d-b799-6883d0df5e0a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:34.974092 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-1f06567d-6f2e-4e5d-b799-6883d0df5e0a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1724 microversion: 2.20 time: 0.205815 Dec 15 13:34:34.974744 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 322/657] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:34:34 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1724 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:34:35.274961 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-904c49e2-bd36-4753-a654-ab2ada4ce5a5 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:35.275569 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-904c49e2-bd36-4753-a654-ab2ada4ce5a5 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] [instance: 3f44ec57-99c3-454f-950c-0853717a6936] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:35.281899 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-904c49e2-bd36-4753-a654-ab2ada4ce5a5 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:35.282348 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-904c49e2-bd36-4753-a654-ab2ada4ce5a5 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:35.283195 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-904c49e2-bd36-4753-a654-ab2ada4ce5a5 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:35.283629 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-904c49e2-bd36-4753-a654-ab2ada4ce5a5 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:35.411516 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-904c49e2-bd36-4753-a654-ab2ada4ce5a5 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52a2c8071134b07bdc222088246a671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050149bd93864d2abd0b342b8062d3d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:35.419486 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-904c49e2-bd36-4753-a654-ab2ada4ce5a5 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] 10.222.0.60 "GET /compute/v2.1/servers/3f44ec57-99c3-454f-950c-0853717a6936" status: 200 len: 1313 microversion: 2.1 time: 0.148198 Dec 15 13:34:35.420072 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 336/658] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:35 2021] GET /compute/v2.1/servers/3f44ec57-99c3-454f-950c-0853717a6936 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:34:35.470066 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-81a0c9b0-85de-4429-b01d-6b657a8dea63 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:35.470667 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-81a0c9b0-85de-4429-b01d-6b657a8dea63 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] [instance: 10dd91a3-b40e-4ac3-ac2c-63624e87cf93] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:35.476867 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-81a0c9b0-85de-4429-b01d-6b657a8dea63 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:35.477312 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-81a0c9b0-85de-4429-b01d-6b657a8dea63 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:35.478112 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-81a0c9b0-85de-4429-b01d-6b657a8dea63 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:35.478551 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-81a0c9b0-85de-4429-b01d-6b657a8dea63 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:35.491768 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.wsgi [None req-81a0c9b0-85de-4429-b01d-6b657a8dea63 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] HTTP exception thrown: Instance 10dd91a3-b40e-4ac3-ac2c-63624e87cf93 could not be found. Dec 15 13:34:35.492340 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-81a0c9b0-85de-4429-b01d-6b657a8dea63 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] Returning 404 to user: Instance 10dd91a3-b40e-4ac3-ac2c-63624e87cf93 could not be found. {{(pid=116941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:34:35.493258 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-81a0c9b0-85de-4429-b01d-6b657a8dea63 tempest-AttachVolumeNegativeTest-1683184427 tempest-AttachVolumeNegativeTest-1683184427-project] 10.222.0.60 "GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93" status: 404 len: 111 microversion: 2.1 time: 0.026704 Dec 15 13:34:35.493776 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 323/659] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:35 2021] GET /compute/v2.1/servers/10dd91a3-b40e-4ac3-ac2c-63624e87cf93 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:34:35.932766 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-b67edf18-b456-4965-a8ce-4f49f53fb131 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:35.933929 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-b67edf18-b456-4965-a8ce-4f49f53fb131 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: d3c2da8c-7e29-48ac-9077-59bffb2c734b] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:35.940642 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b67edf18-b456-4965-a8ce-4f49f53fb131 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:35.941104 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b67edf18-b456-4965-a8ce-4f49f53fb131 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:35.942023 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b67edf18-b456-4965-a8ce-4f49f53fb131 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:35.942547 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b67edf18-b456-4965-a8ce-4f49f53fb131 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:35.992757 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-37561261-08f3-4403-ab4f-6ea8fdde5cc5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:35.993554 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-37561261-08f3-4403-ab4f-6ea8fdde5cc5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:36.000487 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-37561261-08f3-4403-ab4f-6ea8fdde5cc5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:36.001998 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-37561261-08f3-4403-ab4f-6ea8fdde5cc5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:36.002833 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-37561261-08f3-4403-ab4f-6ea8fdde5cc5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:36.004524 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-37561261-08f3-4403-ab4f-6ea8fdde5cc5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:36.029626 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-b67edf18-b456-4965-a8ce-4f49f53fb131 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:36.037033 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-b67edf18-b456-4965-a8ce-4f49f53fb131 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b" status: 200 len: 1466 microversion: 2.1 time: 0.110133 Dec 15 13:34:36.047923 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 337/660] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:35 2021] GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b => generated 1466 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:34:36.176284 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-37561261-08f3-4403-ab4f-6ea8fdde5cc5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:36.184306 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-37561261-08f3-4403-ab4f-6ea8fdde5cc5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:36.185796 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-37561261-08f3-4403-ab4f-6ea8fdde5cc5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:36.187601 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-37561261-08f3-4403-ab4f-6ea8fdde5cc5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1724 microversion: 2.20 time: 0.198906 Dec 15 13:34:36.188330 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 324/661] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:34:35 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1724 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:34:36.439087 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-a30633ac-aa3f-477b-83b6-16e0dee3d8ee tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:36.440008 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-a30633ac-aa3f-477b-83b6-16e0dee3d8ee tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] [instance: 3f44ec57-99c3-454f-950c-0853717a6936] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:36.446661 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a30633ac-aa3f-477b-83b6-16e0dee3d8ee tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:36.447209 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a30633ac-aa3f-477b-83b6-16e0dee3d8ee tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:36.448167 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a30633ac-aa3f-477b-83b6-16e0dee3d8ee tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:36.449265 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a30633ac-aa3f-477b-83b6-16e0dee3d8ee tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:36.561839 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-d13ef313-d92c-40ae-969c-9b95c50ff458 req-d49ab9ba-c6b0-4ff2-a9f4-c282a17ea147 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3c2da8c-7e29-48ac-9077-59bffb2c734b", "name": "network-vif-deleted", "tag": "1f6d7b53-85b8-40d2-b216-fed7cc5d479c"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:36.563928 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:34:36.563928 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: warnings.warn(msg) Dec 15 13:34:36.572149 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-d13ef313-d92c-40ae-969c-9b95c50ff458 req-d49ab9ba-c6b0-4ff2-a9f4-c282a17ea147 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:36.572588 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-d13ef313-d92c-40ae-969c-9b95c50ff458 req-d49ab9ba-c6b0-4ff2-a9f4-c282a17ea147 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:36.586819 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-d13ef313-d92c-40ae-969c-9b95c50ff458 req-d49ab9ba-c6b0-4ff2-a9f4-c282a17ea147 service nova] Creating event network-vif-deleted:1f6d7b53-85b8-40d2-b216-fed7cc5d479c for instance d3c2da8c-7e29-48ac-9077-59bffb2c734b on hv-cinder-81322 Dec 15 13:34:36.592221 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-d13ef313-d92c-40ae-969c-9b95c50ff458 req-d49ab9ba-c6b0-4ff2-a9f4-c282a17ea147 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034868 Dec 15 13:34:36.593087 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 325/662] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:34:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:34:36.616942 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-a30633ac-aa3f-477b-83b6-16e0dee3d8ee tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52a2c8071134b07bdc222088246a671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050149bd93864d2abd0b342b8062d3d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:36.628926 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-a30633ac-aa3f-477b-83b6-16e0dee3d8ee tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] 10.222.0.60 "GET /compute/v2.1/servers/3f44ec57-99c3-454f-950c-0853717a6936" status: 200 len: 1313 microversion: 2.1 time: 0.196237 Dec 15 13:34:36.629497 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 338/663] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:36 2021] GET /compute/v2.1/servers/3f44ec57-99c3-454f-950c-0853717a6936 => generated 1313 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:34:37.015104 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-846a9a95-8f2e-410e-9102-be0946309e42 req-00c00f80-a311-49f8-a557-8a9af7d1430a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f44ec57-99c3-454f-950c-0853717a6936", "name": "network-vif-plugged", "status": "completed", "tag": "63bb9e73-2fd7-4bda-8420-d10b1586e472"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:37.016823 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:34:37.016823 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: warnings.warn(msg) Dec 15 13:34:37.023935 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-846a9a95-8f2e-410e-9102-be0946309e42 req-00c00f80-a311-49f8-a557-8a9af7d1430a service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:37.024358 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-846a9a95-8f2e-410e-9102-be0946309e42 req-00c00f80-a311-49f8-a557-8a9af7d1430a service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:37.036557 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-846a9a95-8f2e-410e-9102-be0946309e42 req-00c00f80-a311-49f8-a557-8a9af7d1430a service nova] Creating event network-vif-plugged:63bb9e73-2fd7-4bda-8420-d10b1586e472 for instance 3f44ec57-99c3-454f-950c-0853717a6936 on hv-cinder-81322 Dec 15 13:34:37.041369 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-846a9a95-8f2e-410e-9102-be0946309e42 req-00c00f80-a311-49f8-a557-8a9af7d1430a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030917 Dec 15 13:34:37.042739 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 326/664] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:34:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:34:37.054482 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-137d27ce-c2cf-4e49-9728-b5c287a7d43b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:37.056421 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-137d27ce-c2cf-4e49-9728-b5c287a7d43b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: d3c2da8c-7e29-48ac-9077-59bffb2c734b] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:37.065617 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-137d27ce-c2cf-4e49-9728-b5c287a7d43b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:37.067341 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-137d27ce-c2cf-4e49-9728-b5c287a7d43b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:37.068394 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-137d27ce-c2cf-4e49-9728-b5c287a7d43b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:37.069040 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-137d27ce-c2cf-4e49-9728-b5c287a7d43b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:37.087464 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.wsgi [None req-137d27ce-c2cf-4e49-9728-b5c287a7d43b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] HTTP exception thrown: Instance d3c2da8c-7e29-48ac-9077-59bffb2c734b could not be found. Dec 15 13:34:37.088279 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-137d27ce-c2cf-4e49-9728-b5c287a7d43b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Returning 404 to user: Instance d3c2da8c-7e29-48ac-9077-59bffb2c734b could not be found. {{(pid=116942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:34:37.090004 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-137d27ce-c2cf-4e49-9728-b5c287a7d43b tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b" status: 404 len: 111 microversion: 2.1 time: 0.039168 Dec 15 13:34:37.090213 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 339/665] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:37 2021] GET /compute/v2.1/servers/d3c2da8c-7e29-48ac-9077-59bffb2c734b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:34:37.098706 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-754d8ab1-530a-46f3-9ff1-03ee359b61cb tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:37.099525 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-754d8ab1-530a-46f3-9ff1-03ee359b61cb tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:37.106079 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-754d8ab1-530a-46f3-9ff1-03ee359b61cb tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:37.106539 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-754d8ab1-530a-46f3-9ff1-03ee359b61cb tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:37.107375 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-754d8ab1-530a-46f3-9ff1-03ee359b61cb tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:37.107950 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-754d8ab1-530a-46f3-9ff1-03ee359b61cb tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:37.133749 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-754d8ab1-530a-46f3-9ff1-03ee359b61cb tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Going to try to terminate instance {{(pid=116941) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:34:37.205396 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-f37ba1f2-cc23-4f18-aeb8-fde5291d6c8c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:37.205826 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-f37ba1f2-cc23-4f18-aeb8-fde5291d6c8c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:37.215593 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f37ba1f2-cc23-4f18-aeb8-fde5291d6c8c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:37.216749 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f37ba1f2-cc23-4f18-aeb8-fde5291d6c8c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:37.219095 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f37ba1f2-cc23-4f18-aeb8-fde5291d6c8c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:37.220192 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f37ba1f2-cc23-4f18-aeb8-fde5291d6c8c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:37.240439 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-754d8ab1-530a-46f3-9ff1-03ee359b61cb tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "DELETE /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a" status: 204 len: 0 microversion: 2.1 time: 0.145504 Dec 15 13:34:37.241044 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 327/666] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Dec 15 13:34:37 2021] DELETE /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 15 13:34:37.249805 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-df9a7caa-658f-4b74-8e40-8a32335b3e39 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:37.250559 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-df9a7caa-658f-4b74-8e40-8a32335b3e39 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:37.256775 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-df9a7caa-658f-4b74-8e40-8a32335b3e39 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:37.257229 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-df9a7caa-658f-4b74-8e40-8a32335b3e39 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:37.258016 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-df9a7caa-658f-4b74-8e40-8a32335b3e39 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:37.258445 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-df9a7caa-658f-4b74-8e40-8a32335b3e39 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:37.637243 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-f37ba1f2-cc23-4f18-aeb8-fde5291d6c8c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:37.640223 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-df9a7caa-658f-4b74-8e40-8a32335b3e39 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:37.646442 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-f37ba1f2-cc23-4f18-aeb8-fde5291d6c8c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:37.648038 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-f37ba1f2-cc23-4f18-aeb8-fde5291d6c8c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:37.648165 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-df9a7caa-658f-4b74-8e40-8a32335b3e39 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a" status: 200 len: 1521 microversion: 2.1 time: 0.402643 Dec 15 13:34:37.648783 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 328/667] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:37 2021] GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a => generated 1521 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:34:37.658178 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-f37ba1f2-cc23-4f18-aeb8-fde5291d6c8c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1724 microversion: 2.20 time: 0.447645 Dec 15 13:34:37.658178 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 340/668] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:34:37 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1724 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:34:37.658178 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-3fc03fc8-e24f-4399-9f36-e58e086e2509 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:37.658178 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-3fc03fc8-e24f-4399-9f36-e58e086e2509 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] [instance: 3f44ec57-99c3-454f-950c-0853717a6936] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:37.663339 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3fc03fc8-e24f-4399-9f36-e58e086e2509 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:37.663837 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3fc03fc8-e24f-4399-9f36-e58e086e2509 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:37.664631 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3fc03fc8-e24f-4399-9f36-e58e086e2509 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:37.665077 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3fc03fc8-e24f-4399-9f36-e58e086e2509 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:37.793896 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-3fc03fc8-e24f-4399-9f36-e58e086e2509 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52a2c8071134b07bdc222088246a671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050149bd93864d2abd0b342b8062d3d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:37.801628 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-3fc03fc8-e24f-4399-9f36-e58e086e2509 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] 10.222.0.60 "GET /compute/v2.1/servers/3f44ec57-99c3-454f-950c-0853717a6936" status: 200 len: 1313 microversion: 2.1 time: 0.150869 Dec 15 13:34:37.802305 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 341/669] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:37 2021] GET /compute/v2.1/servers/3f44ec57-99c3-454f-950c-0853717a6936 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:34:38.665850 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-1a2a0119-c970-4cd2-9463-3a156ca1c3f5 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:38.666469 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-1a2a0119-c970-4cd2-9463-3a156ca1c3f5 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:38.668320 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-1865868a-1d78-429e-b547-e2e9951e063a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:38.669724 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-1865868a-1d78-429e-b547-e2e9951e063a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:38.674104 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1a2a0119-c970-4cd2-9463-3a156ca1c3f5 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:38.674624 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1a2a0119-c970-4cd2-9463-3a156ca1c3f5 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:38.675375 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1a2a0119-c970-4cd2-9463-3a156ca1c3f5 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:38.675807 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1a2a0119-c970-4cd2-9463-3a156ca1c3f5 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:38.677277 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1865868a-1d78-429e-b547-e2e9951e063a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:38.677800 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1865868a-1d78-429e-b547-e2e9951e063a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:38.678816 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1865868a-1d78-429e-b547-e2e9951e063a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:38.679887 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1865868a-1d78-429e-b547-e2e9951e063a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:38.951048 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-1a2a0119-c970-4cd2-9463-3a156ca1c3f5 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:38.956326 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-1865868a-1d78-429e-b547-e2e9951e063a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:38.959011 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-1a2a0119-c970-4cd2-9463-3a156ca1c3f5 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a" status: 200 len: 1521 microversion: 2.1 time: 0.297186 Dec 15 13:34:38.959583 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 329/670] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:38 2021] GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a => generated 1521 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:34:38.966040 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-6643ba8b-2f26-4cd7-bf94-db4917655e4b tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:38.966736 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-6643ba8b-2f26-4cd7-bf94-db4917655e4b tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] [instance: 3f44ec57-99c3-454f-950c-0853717a6936] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:38.973084 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6643ba8b-2f26-4cd7-bf94-db4917655e4b tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:38.973540 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6643ba8b-2f26-4cd7-bf94-db4917655e4b tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:38.974409 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6643ba8b-2f26-4cd7-bf94-db4917655e4b tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:38.975057 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6643ba8b-2f26-4cd7-bf94-db4917655e4b tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:38.979552 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-1865868a-1d78-429e-b547-e2e9951e063a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:38.983181 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-1865868a-1d78-429e-b547-e2e9951e063a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:38.990259 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-1865868a-1d78-429e-b547-e2e9951e063a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1724 microversion: 2.20 time: 0.321117 Dec 15 13:34:38.991149 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 342/671] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:34:38 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1724 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:34:39.115151 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-6643ba8b-2f26-4cd7-bf94-db4917655e4b tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52a2c8071134b07bdc222088246a671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050149bd93864d2abd0b342b8062d3d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:39.123206 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-6643ba8b-2f26-4cd7-bf94-db4917655e4b tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] 10.222.0.60 "GET /compute/v2.1/servers/3f44ec57-99c3-454f-950c-0853717a6936" status: 200 len: 1496 microversion: 2.1 time: 0.162373 Dec 15 13:34:39.123889 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 330/672] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:38 2021] GET /compute/v2.1/servers/3f44ec57-99c3-454f-950c-0853717a6936 => generated 1496 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:34:39.557245 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ee260f24-1c71-4b69-84fd-d8ae7d70bba4 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:39.558005 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ee260f24-1c71-4b69-84fd-d8ae7d70bba4 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] [instance: 3f44ec57-99c3-454f-950c-0853717a6936] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:39.564762 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ee260f24-1c71-4b69-84fd-d8ae7d70bba4 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:39.565483 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ee260f24-1c71-4b69-84fd-d8ae7d70bba4 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:39.566773 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ee260f24-1c71-4b69-84fd-d8ae7d70bba4 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:39.567686 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ee260f24-1c71-4b69-84fd-d8ae7d70bba4 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:39.597474 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ee260f24-1c71-4b69-84fd-d8ae7d70bba4 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] [instance: 3f44ec57-99c3-454f-950c-0853717a6936] Going to try to terminate instance {{(pid=116942) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:34:39.688368 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ee260f24-1c71-4b69-84fd-d8ae7d70bba4 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3f44ec57-99c3-454f-950c-0853717a6936" status: 204 len: 0 microversion: 2.1 time: 0.134506 Dec 15 13:34:39.694301 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 343/673] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Dec 15 13:34:39 2021] DELETE /compute/v2.1/servers/3f44ec57-99c3-454f-950c-0853717a6936 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:34:39.699942 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-59856185-3699-4a40-a7e2-f75f9f071176 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:39.700709 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-59856185-3699-4a40-a7e2-f75f9f071176 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] [instance: 3f44ec57-99c3-454f-950c-0853717a6936] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:39.707423 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-59856185-3699-4a40-a7e2-f75f9f071176 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:39.708071 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-59856185-3699-4a40-a7e2-f75f9f071176 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:39.708878 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-59856185-3699-4a40-a7e2-f75f9f071176 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:39.709332 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-59856185-3699-4a40-a7e2-f75f9f071176 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:39.841651 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-59856185-3699-4a40-a7e2-f75f9f071176 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52a2c8071134b07bdc222088246a671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050149bd93864d2abd0b342b8062d3d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:39.849010 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-59856185-3699-4a40-a7e2-f75f9f071176 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] 10.222.0.60 "GET /compute/v2.1/servers/3f44ec57-99c3-454f-950c-0853717a6936" status: 200 len: 1502 microversion: 2.1 time: 0.154421 Dec 15 13:34:39.849676 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 331/674] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:39 2021] GET /compute/v2.1/servers/3f44ec57-99c3-454f-950c-0853717a6936 => generated 1502 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:34:39.977344 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-91ba4b10-25e5-4992-99f4-6a3b2aa1bd7e tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:39.978079 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-91ba4b10-25e5-4992-99f4-6a3b2aa1bd7e tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:39.983814 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-91ba4b10-25e5-4992-99f4-6a3b2aa1bd7e tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:39.984273 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-91ba4b10-25e5-4992-99f4-6a3b2aa1bd7e tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:39.985086 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-91ba4b10-25e5-4992-99f4-6a3b2aa1bd7e tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:39.985524 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-91ba4b10-25e5-4992-99f4-6a3b2aa1bd7e tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:40.009062 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-6dd95a3f-ffb2-4aa9-a2bd-35d618564914 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:40.009829 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-6dd95a3f-ffb2-4aa9-a2bd-35d618564914 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:40.017075 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6dd95a3f-ffb2-4aa9-a2bd-35d618564914 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:40.017668 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6dd95a3f-ffb2-4aa9-a2bd-35d618564914 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:40.018563 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6dd95a3f-ffb2-4aa9-a2bd-35d618564914 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:40.019129 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6dd95a3f-ffb2-4aa9-a2bd-35d618564914 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:40.194746 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-91ba4b10-25e5-4992-99f4-6a3b2aa1bd7e tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:40.199324 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-6dd95a3f-ffb2-4aa9-a2bd-35d618564914 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:40.204173 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-91ba4b10-25e5-4992-99f4-6a3b2aa1bd7e tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a" status: 200 len: 1521 microversion: 2.1 time: 0.230809 Dec 15 13:34:40.205081 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 344/675] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:39 2021] GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:34:40.209496 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-6dd95a3f-ffb2-4aa9-a2bd-35d618564914 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:40.211174 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-6dd95a3f-ffb2-4aa9-a2bd-35d618564914 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:40.212401 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-6dd95a3f-ffb2-4aa9-a2bd-35d618564914 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1724 microversion: 2.20 time: 0.207254 Dec 15 13:34:40.213029 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 332/676] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:34:40 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1724 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:34:40.866007 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-f4d8bfae-9845-4232-9776-a7c56ce67e4f tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:40.866542 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-f4d8bfae-9845-4232-9776-a7c56ce67e4f tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] [instance: 3f44ec57-99c3-454f-950c-0853717a6936] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:40.873475 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f4d8bfae-9845-4232-9776-a7c56ce67e4f tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:40.873918 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f4d8bfae-9845-4232-9776-a7c56ce67e4f tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:40.874689 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f4d8bfae-9845-4232-9776-a7c56ce67e4f tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:40.875218 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f4d8bfae-9845-4232-9776-a7c56ce67e4f tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:41.012938 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-f4d8bfae-9845-4232-9776-a7c56ce67e4f tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52a2c8071134b07bdc222088246a671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050149bd93864d2abd0b342b8062d3d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:41.020438 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-f4d8bfae-9845-4232-9776-a7c56ce67e4f tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] 10.222.0.60 "GET /compute/v2.1/servers/3f44ec57-99c3-454f-950c-0853717a6936" status: 200 len: 1502 microversion: 2.1 time: 0.158077 Dec 15 13:34:41.021386 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 345/677] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:40 2021] GET /compute/v2.1/servers/3f44ec57-99c3-454f-950c-0853717a6936 => generated 1502 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:34:41.220292 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-93da5547-0d18-4987-8ccd-727a1afb0ed1 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:41.220905 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-93da5547-0d18-4987-8ccd-727a1afb0ed1 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:41.227429 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-93da5547-0d18-4987-8ccd-727a1afb0ed1 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:41.227883 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-93da5547-0d18-4987-8ccd-727a1afb0ed1 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:41.228696 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-93da5547-0d18-4987-8ccd-727a1afb0ed1 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:41.229143 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-93da5547-0d18-4987-8ccd-727a1afb0ed1 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:41.233502 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-43d55899-7b22-46d6-8b13-2dabc3a1ad8d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:41.234260 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-43d55899-7b22-46d6-8b13-2dabc3a1ad8d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:41.240144 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-43d55899-7b22-46d6-8b13-2dabc3a1ad8d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:41.240668 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-43d55899-7b22-46d6-8b13-2dabc3a1ad8d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:41.241478 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-43d55899-7b22-46d6-8b13-2dabc3a1ad8d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:41.242065 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-43d55899-7b22-46d6-8b13-2dabc3a1ad8d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:41.428285 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-93da5547-0d18-4987-8ccd-727a1afb0ed1 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:41.431629 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-43d55899-7b22-46d6-8b13-2dabc3a1ad8d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:41.436528 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-93da5547-0d18-4987-8ccd-727a1afb0ed1 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a" status: 200 len: 1521 microversion: 2.1 time: 0.219929 Dec 15 13:34:41.437189 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 333/678] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:41 2021] GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:34:41.440418 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-43d55899-7b22-46d6-8b13-2dabc3a1ad8d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:41.441913 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-43d55899-7b22-46d6-8b13-2dabc3a1ad8d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:41.443099 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-43d55899-7b22-46d6-8b13-2dabc3a1ad8d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1724 microversion: 2.20 time: 0.216989 Dec 15 13:34:41.443659 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 346/679] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:34:41 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:34:41.849297 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-a6fd76db-e415-456e-8455-7b38b90e416f tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:41.856525 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a6fd76db-e415-456e-8455-7b38b90e416f tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:41.856982 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a6fd76db-e415-456e-8455-7b38b90e416f tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:41.925917 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-a6fd76db-e415-456e-8455-7b38b90e416f tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Going to try to stop instance {{(pid=116941) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 15 13:34:41.983761 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-a6fd76db-e415-456e-8455-7b38b90e416f tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 202 len: 0 microversion: 2.1 time: 0.141607 Dec 15 13:34:41.990239 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 334/680] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:34:41 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:34:41.995601 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-b9afb8ae-ea07-438c-b534-18b54e2891e7 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:41.997108 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-b9afb8ae-ea07-438c-b534-18b54e2891e7 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:42.017531 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-73796116-e036-4308-a40a-9762dc886df7 req-7c3e051a-1536-423e-aff5-e78aa3c5a661 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f44ec57-99c3-454f-950c-0853717a6936", "name": "network-vif-deleted", "tag": "63bb9e73-2fd7-4bda-8420-d10b1586e472"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:42.019362 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:34:42.019362 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: warnings.warn(msg) Dec 15 13:34:42.019580 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b9afb8ae-ea07-438c-b534-18b54e2891e7 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:42.020052 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b9afb8ae-ea07-438c-b534-18b54e2891e7 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:42.021203 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b9afb8ae-ea07-438c-b534-18b54e2891e7 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:42.021741 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b9afb8ae-ea07-438c-b534-18b54e2891e7 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:42.030198 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-73796116-e036-4308-a40a-9762dc886df7 req-7c3e051a-1536-423e-aff5-e78aa3c5a661 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:42.030744 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-73796116-e036-4308-a40a-9762dc886df7 req-7c3e051a-1536-423e-aff5-e78aa3c5a661 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:42.044678 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-73796116-e036-4308-a40a-9762dc886df7 req-7c3e051a-1536-423e-aff5-e78aa3c5a661 service nova] Creating event network-vif-deleted:63bb9e73-2fd7-4bda-8420-d10b1586e472 for instance 3f44ec57-99c3-454f-950c-0853717a6936 on hv-cinder-81322 Dec 15 13:34:42.049869 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-73796116-e036-4308-a40a-9762dc886df7 req-7c3e051a-1536-423e-aff5-e78aa3c5a661 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042104 Dec 15 13:34:42.050956 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 335/681] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:34:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:34:42.059031 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-ad0c3558-ba5e-423b-b887-4442ea77d7a4 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:42.059031 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-ad0c3558-ba5e-423b-b887-4442ea77d7a4 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] [instance: 3f44ec57-99c3-454f-950c-0853717a6936] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:42.064166 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ad0c3558-ba5e-423b-b887-4442ea77d7a4 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:42.064759 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ad0c3558-ba5e-423b-b887-4442ea77d7a4 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:42.065621 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ad0c3558-ba5e-423b-b887-4442ea77d7a4 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:42.066144 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ad0c3558-ba5e-423b-b887-4442ea77d7a4 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:42.161405 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-ad0c3558-ba5e-423b-b887-4442ea77d7a4 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52a2c8071134b07bdc222088246a671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050149bd93864d2abd0b342b8062d3d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:42.169818 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-ad0c3558-ba5e-423b-b887-4442ea77d7a4 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] 10.222.0.60 "GET /compute/v2.1/servers/3f44ec57-99c3-454f-950c-0853717a6936" status: 200 len: 1298 microversion: 2.1 time: 0.117386 Dec 15 13:34:42.170414 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 336/682] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:42 2021] GET /compute/v2.1/servers/3f44ec57-99c3-454f-950c-0853717a6936 => generated 1298 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:34:42.192260 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-b9afb8ae-ea07-438c-b534-18b54e2891e7 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:42.200917 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-b9afb8ae-ea07-438c-b534-18b54e2891e7 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1724 microversion: 2.1 time: 0.209419 Dec 15 13:34:42.201488 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 347/683] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:41 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1724 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:34:42.453807 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-acbb66b2-60dd-4820-88f7-ae6c44ebd8cd tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:42.454345 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-acbb66b2-60dd-4820-88f7-ae6c44ebd8cd tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:42.460985 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-acbb66b2-60dd-4820-88f7-ae6c44ebd8cd tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:42.461397 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-6cf71054-0a6c-42a3-ba55-4f2b368af28b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:42.461556 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-acbb66b2-60dd-4820-88f7-ae6c44ebd8cd tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:42.462217 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-acbb66b2-60dd-4820-88f7-ae6c44ebd8cd tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:42.462341 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-6cf71054-0a6c-42a3-ba55-4f2b368af28b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:42.462657 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-acbb66b2-60dd-4820-88f7-ae6c44ebd8cd tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:42.468045 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6cf71054-0a6c-42a3-ba55-4f2b368af28b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:42.468718 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6cf71054-0a6c-42a3-ba55-4f2b368af28b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:42.471156 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6cf71054-0a6c-42a3-ba55-4f2b368af28b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:42.471609 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6cf71054-0a6c-42a3-ba55-4f2b368af28b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:42.663488 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-acbb66b2-60dd-4820-88f7-ae6c44ebd8cd tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:42.669826 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-6cf71054-0a6c-42a3-ba55-4f2b368af28b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:42.673521 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-acbb66b2-60dd-4820-88f7-ae6c44ebd8cd tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a" status: 200 len: 1521 microversion: 2.1 time: 0.223367 Dec 15 13:34:42.674181 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 337/684] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:42 2021] GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:34:42.677394 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-6cf71054-0a6c-42a3-ba55-4f2b368af28b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:42.678955 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-6cf71054-0a6c-42a3-ba55-4f2b368af28b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:42.680554 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-6cf71054-0a6c-42a3-ba55-4f2b368af28b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1724 microversion: 2.20 time: 0.222761 Dec 15 13:34:42.681119 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 348/685] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:34:42 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:34:43.185350 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-0f8577c6-8732-43b4-9f2b-3f060d446787 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:43.185957 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-0f8577c6-8732-43b4-9f2b-3f060d446787 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] [instance: 3f44ec57-99c3-454f-950c-0853717a6936] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:43.192137 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0f8577c6-8732-43b4-9f2b-3f060d446787 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:43.192595 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0f8577c6-8732-43b4-9f2b-3f060d446787 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:43.193390 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0f8577c6-8732-43b4-9f2b-3f060d446787 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:43.193829 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0f8577c6-8732-43b4-9f2b-3f060d446787 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:43.210991 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.wsgi [None req-0f8577c6-8732-43b4-9f2b-3f060d446787 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] HTTP exception thrown: Instance 3f44ec57-99c3-454f-950c-0853717a6936 could not be found. Dec 15 13:34:43.211608 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-0f8577c6-8732-43b4-9f2b-3f060d446787 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] Returning 404 to user: Instance 3f44ec57-99c3-454f-950c-0853717a6936 could not be found. {{(pid=116941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:34:43.212475 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-0f8577c6-8732-43b4-9f2b-3f060d446787 tempest-VolumesActionsTest-1306617640 tempest-VolumesActionsTest-1306617640-project] 10.222.0.60 "GET /compute/v2.1/servers/3f44ec57-99c3-454f-950c-0853717a6936" status: 404 len: 111 microversion: 2.1 time: 0.030798 Dec 15 13:34:43.213036 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 338/686] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:43 2021] GET /compute/v2.1/servers/3f44ec57-99c3-454f-950c-0853717a6936 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:34:43.218986 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-b5027645-b541-4413-810e-3efe9dd6445b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:43.219979 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-b5027645-b541-4413-810e-3efe9dd6445b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:43.227312 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b5027645-b541-4413-810e-3efe9dd6445b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:43.227764 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b5027645-b541-4413-810e-3efe9dd6445b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:43.228553 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b5027645-b541-4413-810e-3efe9dd6445b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:43.228988 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b5027645-b541-4413-810e-3efe9dd6445b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:43.376629 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-b5027645-b541-4413-810e-3efe9dd6445b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:43.386899 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-b5027645-b541-4413-810e-3efe9dd6445b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1724 microversion: 2.1 time: 0.173208 Dec 15 13:34:43.396824 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 349/687] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:43 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:34:43.700296 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-7586c559-c2a6-403f-8d40-d6ad33d092b5 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:43.701462 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-7586c559-c2a6-403f-8d40-d6ad33d092b5 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:43.703165 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-e39e1a2e-7505-4459-bb4a-61033f856aae tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:43.703801 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-e39e1a2e-7505-4459-bb4a-61033f856aae tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:43.708577 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7586c559-c2a6-403f-8d40-d6ad33d092b5 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:43.709342 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7586c559-c2a6-403f-8d40-d6ad33d092b5 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:43.710374 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7586c559-c2a6-403f-8d40-d6ad33d092b5 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:43.711067 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7586c559-c2a6-403f-8d40-d6ad33d092b5 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:43.716343 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e39e1a2e-7505-4459-bb4a-61033f856aae tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:43.716809 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e39e1a2e-7505-4459-bb4a-61033f856aae tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:43.717625 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e39e1a2e-7505-4459-bb4a-61033f856aae tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:43.718064 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e39e1a2e-7505-4459-bb4a-61033f856aae tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:43.978091 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-7586c559-c2a6-403f-8d40-d6ad33d092b5 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:43.988511 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-7586c559-c2a6-403f-8d40-d6ad33d092b5 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a" status: 200 len: 1521 microversion: 2.1 time: 0.292290 Dec 15 13:34:43.991802 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 339/688] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:43 2021] GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a => generated 1521 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:34:44.044474 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-e39e1a2e-7505-4459-bb4a-61033f856aae tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:44.052553 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-e39e1a2e-7505-4459-bb4a-61033f856aae tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:44.054084 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-e39e1a2e-7505-4459-bb4a-61033f856aae tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:44.055430 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-e39e1a2e-7505-4459-bb4a-61033f856aae tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1724 microversion: 2.20 time: 0.359037 Dec 15 13:34:44.067323 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 350/689] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:34:43 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1724 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:34:44.072158 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-608a3f43-c1c1-4406-be8d-d5ae8c84b30c req-8e829dc1-9430-4cca-8fab-2c1e38f7655f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eab2a5ce-9a56-4120-ae3c-ddfb844aa30a", "name": "network-vif-deleted", "tag": "a1a46728-afb1-43b7-8e1d-b0e5ecdf5e2d"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:34:44.075377 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:34:44.075377 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: warnings.warn(msg) Dec 15 13:34:44.082704 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-608a3f43-c1c1-4406-be8d-d5ae8c84b30c req-8e829dc1-9430-4cca-8fab-2c1e38f7655f service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:44.083215 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-608a3f43-c1c1-4406-be8d-d5ae8c84b30c req-8e829dc1-9430-4cca-8fab-2c1e38f7655f service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:44.098332 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-608a3f43-c1c1-4406-be8d-d5ae8c84b30c req-8e829dc1-9430-4cca-8fab-2c1e38f7655f service nova] Creating event network-vif-deleted:a1a46728-afb1-43b7-8e1d-b0e5ecdf5e2d for instance eab2a5ce-9a56-4120-ae3c-ddfb844aa30a on hv-cinder-81322 Dec 15 13:34:44.104560 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-608a3f43-c1c1-4406-be8d-d5ae8c84b30c req-8e829dc1-9430-4cca-8fab-2c1e38f7655f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038318 Dec 15 13:34:44.105177 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 340/690] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:34:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:34:44.404426 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-416d8ffc-29ee-46b4-a997-a20f384084e1 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:44.405126 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-416d8ffc-29ee-46b4-a997-a20f384084e1 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:44.411393 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-416d8ffc-29ee-46b4-a997-a20f384084e1 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:44.411851 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-416d8ffc-29ee-46b4-a997-a20f384084e1 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:44.412780 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-416d8ffc-29ee-46b4-a997-a20f384084e1 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:44.413226 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-416d8ffc-29ee-46b4-a997-a20f384084e1 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:44.571255 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-416d8ffc-29ee-46b4-a997-a20f384084e1 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:44.579188 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-416d8ffc-29ee-46b4-a997-a20f384084e1 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1724 microversion: 2.1 time: 0.178455 Dec 15 13:34:44.579781 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 351/691] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:44 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:34:45.008658 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-19fe0532-7c32-4c25-be8b-1a3e03836e17 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:45.009358 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-19fe0532-7c32-4c25-be8b-1a3e03836e17 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:45.016478 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-19fe0532-7c32-4c25-be8b-1a3e03836e17 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:45.016956 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-19fe0532-7c32-4c25-be8b-1a3e03836e17 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:45.017728 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-19fe0532-7c32-4c25-be8b-1a3e03836e17 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:45.018162 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-19fe0532-7c32-4c25-be8b-1a3e03836e17 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:45.049809 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-19fe0532-7c32-4c25-be8b-1a3e03836e17 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:45.050275 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-19fe0532-7c32-4c25-be8b-1a3e03836e17 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:45.050764 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.objects.instance [None req-19fe0532-7c32-4c25-be8b-1a3e03836e17 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lazy-loading 'fault' on Instance uuid eab2a5ce-9a56-4120-ae3c-ddfb844aa30a {{(pid=116941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:34:45.074134 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-8f913875-705b-476c-9715-26449a52dd5b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:45.074749 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-8f913875-705b-476c-9715-26449a52dd5b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:45.082254 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8f913875-705b-476c-9715-26449a52dd5b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:45.082254 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8f913875-705b-476c-9715-26449a52dd5b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:45.082254 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8f913875-705b-476c-9715-26449a52dd5b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:45.082585 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8f913875-705b-476c-9715-26449a52dd5b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:45.101480 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-19fe0532-7c32-4c25-be8b-1a3e03836e17 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:45.109075 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-19fe0532-7c32-4c25-be8b-1a3e03836e17 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a" status: 200 len: 1312 microversion: 2.1 time: 0.104339 Dec 15 13:34:45.109937 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 341/692] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:45 2021] GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a => generated 1312 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:34:45.220348 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-8f913875-705b-476c-9715-26449a52dd5b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:45.228352 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-8f913875-705b-476c-9715-26449a52dd5b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:45.229871 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-8f913875-705b-476c-9715-26449a52dd5b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:45.231044 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-8f913875-705b-476c-9715-26449a52dd5b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1724 microversion: 2.20 time: 0.161516 Dec 15 13:34:45.231605 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 352/693] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:34:45 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:34:45.595809 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-c114114b-f075-498b-bbdc-4f6179d89517 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:45.596423 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-c114114b-f075-498b-bbdc-4f6179d89517 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:45.602085 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c114114b-f075-498b-bbdc-4f6179d89517 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:45.602536 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c114114b-f075-498b-bbdc-4f6179d89517 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:45.603780 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c114114b-f075-498b-bbdc-4f6179d89517 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:45.604090 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c114114b-f075-498b-bbdc-4f6179d89517 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:45.737963 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-c114114b-f075-498b-bbdc-4f6179d89517 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:45.746316 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-c114114b-f075-498b-bbdc-4f6179d89517 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1724 microversion: 2.1 time: 0.154251 Dec 15 13:34:45.746902 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 342/694] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:45 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:34:46.125079 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-9b4e1f80-f06e-4778-abf4-0ae28453c411 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:46.126242 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-9b4e1f80-f06e-4778-abf4-0ae28453c411 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:46.132522 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9b4e1f80-f06e-4778-abf4-0ae28453c411 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:46.133040 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9b4e1f80-f06e-4778-abf4-0ae28453c411 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:46.133897 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9b4e1f80-f06e-4778-abf4-0ae28453c411 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:46.134403 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9b4e1f80-f06e-4778-abf4-0ae28453c411 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:46.166619 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9b4e1f80-f06e-4778-abf4-0ae28453c411 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:46.167652 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9b4e1f80-f06e-4778-abf4-0ae28453c411 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:46.168360 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.objects.instance [None req-9b4e1f80-f06e-4778-abf4-0ae28453c411 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lazy-loading 'fault' on Instance uuid eab2a5ce-9a56-4120-ae3c-ddfb844aa30a {{(pid=116942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:34:46.214432 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-9b4e1f80-f06e-4778-abf4-0ae28453c411 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53d77fd836e4abda2cb59d5ed6c370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6898e751314d4e94af3fc6df9b465470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:46.222376 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-9b4e1f80-f06e-4778-abf4-0ae28453c411 tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a" status: 200 len: 1312 microversion: 2.1 time: 0.100816 Dec 15 13:34:46.223214 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 353/695] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:46 2021] GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a => generated 1312 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:34:46.250465 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-45008346-542e-4525-ba8d-13c444b68c09 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:46.251624 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-45008346-542e-4525-ba8d-13c444b68c09 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:46.257855 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-45008346-542e-4525-ba8d-13c444b68c09 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:46.258303 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-45008346-542e-4525-ba8d-13c444b68c09 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:46.259112 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-45008346-542e-4525-ba8d-13c444b68c09 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:46.259729 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-45008346-542e-4525-ba8d-13c444b68c09 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:46.388988 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-45008346-542e-4525-ba8d-13c444b68c09 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:46.396643 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-45008346-542e-4525-ba8d-13c444b68c09 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:46.398150 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-45008346-542e-4525-ba8d-13c444b68c09 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:46.399347 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-45008346-542e-4525-ba8d-13c444b68c09 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1724 microversion: 2.20 time: 0.153095 Dec 15 13:34:46.399912 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 343/696] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:34:46 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:34:46.763594 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-a8448665-995f-42c2-a178-fbea36a9ef88 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:46.764237 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-a8448665-995f-42c2-a178-fbea36a9ef88 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:46.770153 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a8448665-995f-42c2-a178-fbea36a9ef88 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:46.770608 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a8448665-995f-42c2-a178-fbea36a9ef88 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:46.771430 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a8448665-995f-42c2-a178-fbea36a9ef88 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:46.771883 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a8448665-995f-42c2-a178-fbea36a9ef88 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:46.897627 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-a8448665-995f-42c2-a178-fbea36a9ef88 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:46.905955 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-a8448665-995f-42c2-a178-fbea36a9ef88 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1724 microversion: 2.1 time: 0.146003 Dec 15 13:34:46.906535 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 354/697] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:46 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1724 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:34:47.239675 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-eb59aa6e-5f58-4966-b2ff-90273ab3c41f tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:47.240283 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-eb59aa6e-5f58-4966-b2ff-90273ab3c41f tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] [instance: eab2a5ce-9a56-4120-ae3c-ddfb844aa30a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:47.246416 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-eb59aa6e-5f58-4966-b2ff-90273ab3c41f tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:47.247185 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-eb59aa6e-5f58-4966-b2ff-90273ab3c41f tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:47.247674 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-eb59aa6e-5f58-4966-b2ff-90273ab3c41f tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:47.248112 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-eb59aa6e-5f58-4966-b2ff-90273ab3c41f tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:47.261840 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.wsgi [None req-eb59aa6e-5f58-4966-b2ff-90273ab3c41f tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] HTTP exception thrown: Instance eab2a5ce-9a56-4120-ae3c-ddfb844aa30a could not be found. Dec 15 13:34:47.262464 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-eb59aa6e-5f58-4966-b2ff-90273ab3c41f tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] Returning 404 to user: Instance eab2a5ce-9a56-4120-ae3c-ddfb844aa30a could not be found. {{(pid=116941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:34:47.263327 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-eb59aa6e-5f58-4966-b2ff-90273ab3c41f tempest-ServerRescueNegativeTestJSON-1239341900 tempest-ServerRescueNegativeTestJSON-1239341900-project] 10.222.0.60 "GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a" status: 404 len: 111 microversion: 2.1 time: 0.027357 Dec 15 13:34:47.263872 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 344/698] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:47 2021] GET /compute/v2.1/servers/eab2a5ce-9a56-4120-ae3c-ddfb844aa30a => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:34:47.417392 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-07f4f7ad-c47d-4c58-b31f-0eec37f02337 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:47.418001 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-07f4f7ad-c47d-4c58-b31f-0eec37f02337 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:47.424318 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-07f4f7ad-c47d-4c58-b31f-0eec37f02337 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:47.424777 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-07f4f7ad-c47d-4c58-b31f-0eec37f02337 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:47.425565 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-07f4f7ad-c47d-4c58-b31f-0eec37f02337 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:47.426006 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-07f4f7ad-c47d-4c58-b31f-0eec37f02337 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:47.559448 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-07f4f7ad-c47d-4c58-b31f-0eec37f02337 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:47.567144 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-07f4f7ad-c47d-4c58-b31f-0eec37f02337 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:47.568649 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-07f4f7ad-c47d-4c58-b31f-0eec37f02337 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:47.570079 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-07f4f7ad-c47d-4c58-b31f-0eec37f02337 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1724 microversion: 2.20 time: 0.156239 Dec 15 13:34:47.570662 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 355/699] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:34:47 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:34:47.923789 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-a0006aae-bde4-446e-a739-fd1ba3963013 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:47.924319 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-a0006aae-bde4-446e-a739-fd1ba3963013 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:47.930084 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a0006aae-bde4-446e-a739-fd1ba3963013 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:47.930540 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a0006aae-bde4-446e-a739-fd1ba3963013 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:47.931354 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a0006aae-bde4-446e-a739-fd1ba3963013 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:47.931798 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a0006aae-bde4-446e-a739-fd1ba3963013 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:48.062219 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-a0006aae-bde4-446e-a739-fd1ba3963013 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:48.070606 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-a0006aae-bde4-446e-a739-fd1ba3963013 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1724 microversion: 2.1 time: 0.150608 Dec 15 13:34:48.071209 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 345/700] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:47 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:34:48.592496 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-6e28fd19-ad9f-4cbf-9d2c-c07af54f7fb5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:48.593133 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-6e28fd19-ad9f-4cbf-9d2c-c07af54f7fb5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:48.599122 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6e28fd19-ad9f-4cbf-9d2c-c07af54f7fb5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:48.599570 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6e28fd19-ad9f-4cbf-9d2c-c07af54f7fb5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:48.600346 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6e28fd19-ad9f-4cbf-9d2c-c07af54f7fb5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:48.600777 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6e28fd19-ad9f-4cbf-9d2c-c07af54f7fb5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:48.750930 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-6e28fd19-ad9f-4cbf-9d2c-c07af54f7fb5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:48.759489 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-6e28fd19-ad9f-4cbf-9d2c-c07af54f7fb5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:48.761524 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-6e28fd19-ad9f-4cbf-9d2c-c07af54f7fb5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:48.762718 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-6e28fd19-ad9f-4cbf-9d2c-c07af54f7fb5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1724 microversion: 2.20 time: 0.174448 Dec 15 13:34:48.763539 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 356/701] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:34:48 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:34:49.087506 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-bcf0ae53-b052-4778-866c-c729763b6ba7 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:49.088305 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-bcf0ae53-b052-4778-866c-c729763b6ba7 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:49.095010 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bcf0ae53-b052-4778-866c-c729763b6ba7 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:49.095719 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bcf0ae53-b052-4778-866c-c729763b6ba7 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:49.096793 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bcf0ae53-b052-4778-866c-c729763b6ba7 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:49.097357 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bcf0ae53-b052-4778-866c-c729763b6ba7 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:49.246863 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-bcf0ae53-b052-4778-866c-c729763b6ba7 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:49.255101 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-bcf0ae53-b052-4778-866c-c729763b6ba7 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1724 microversion: 2.1 time: 0.171278 Dec 15 13:34:49.255898 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 346/702] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:49 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:34:49.780900 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-85bb0c18-958d-4ac3-b183-0052c77581ce tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:49.781862 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-85bb0c18-958d-4ac3-b183-0052c77581ce tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:49.789077 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-85bb0c18-958d-4ac3-b183-0052c77581ce tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:49.789851 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-85bb0c18-958d-4ac3-b183-0052c77581ce tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:49.791308 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-85bb0c18-958d-4ac3-b183-0052c77581ce tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:49.792843 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-85bb0c18-958d-4ac3-b183-0052c77581ce tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:50.027678 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-85bb0c18-958d-4ac3-b183-0052c77581ce tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:50.036412 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-85bb0c18-958d-4ac3-b183-0052c77581ce tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:50.037898 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-85bb0c18-958d-4ac3-b183-0052c77581ce tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:50.039100 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-85bb0c18-958d-4ac3-b183-0052c77581ce tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1724 microversion: 2.20 time: 0.262073 Dec 15 13:34:50.039780 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 357/703] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:34:49 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1724 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:34:50.272965 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-5760ed0a-9e9c-4c95-85ec-d0e6e94d656d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:50.274742 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-5760ed0a-9e9c-4c95-85ec-d0e6e94d656d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:50.286742 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5760ed0a-9e9c-4c95-85ec-d0e6e94d656d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:50.287311 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5760ed0a-9e9c-4c95-85ec-d0e6e94d656d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:50.288130 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5760ed0a-9e9c-4c95-85ec-d0e6e94d656d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:50.288581 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5760ed0a-9e9c-4c95-85ec-d0e6e94d656d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:50.505026 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-5760ed0a-9e9c-4c95-85ec-d0e6e94d656d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:50.522041 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-5760ed0a-9e9c-4c95-85ec-d0e6e94d656d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1724 microversion: 2.1 time: 0.251009 Dec 15 13:34:50.523466 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 347/704] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:50 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1724 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:34:51.058684 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-fff9168f-9c46-4e08-9913-b20e2bca0ea2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:51.060496 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-fff9168f-9c46-4e08-9913-b20e2bca0ea2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:51.068423 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-fff9168f-9c46-4e08-9913-b20e2bca0ea2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:51.069023 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-fff9168f-9c46-4e08-9913-b20e2bca0ea2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:51.070957 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-fff9168f-9c46-4e08-9913-b20e2bca0ea2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:51.071623 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-fff9168f-9c46-4e08-9913-b20e2bca0ea2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:51.235506 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-fff9168f-9c46-4e08-9913-b20e2bca0ea2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:51.244710 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-fff9168f-9c46-4e08-9913-b20e2bca0ea2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:51.246774 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-fff9168f-9c46-4e08-9913-b20e2bca0ea2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:51.248064 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-fff9168f-9c46-4e08-9913-b20e2bca0ea2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1724 microversion: 2.20 time: 0.194505 Dec 15 13:34:51.248992 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 358/705] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:34:51 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:34:51.540205 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-f832410f-1978-4a06-8797-73913f89ba20 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:51.541575 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-f832410f-1978-4a06-8797-73913f89ba20 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:51.550026 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f832410f-1978-4a06-8797-73913f89ba20 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:51.550710 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f832410f-1978-4a06-8797-73913f89ba20 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:51.551762 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f832410f-1978-4a06-8797-73913f89ba20 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:51.552415 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f832410f-1978-4a06-8797-73913f89ba20 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:51.715202 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-f832410f-1978-4a06-8797-73913f89ba20 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:51.724816 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-f832410f-1978-4a06-8797-73913f89ba20 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1724 microversion: 2.1 time: 0.188543 Dec 15 13:34:51.727865 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 348/706] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:51 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:34:52.267117 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-34e99606-2af2-409b-a6e6-3c282b11a59b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:52.267749 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-34e99606-2af2-409b-a6e6-3c282b11a59b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:52.274137 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-34e99606-2af2-409b-a6e6-3c282b11a59b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:52.275343 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-34e99606-2af2-409b-a6e6-3c282b11a59b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:52.276932 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-34e99606-2af2-409b-a6e6-3c282b11a59b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:52.277534 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-34e99606-2af2-409b-a6e6-3c282b11a59b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:52.465495 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-34e99606-2af2-409b-a6e6-3c282b11a59b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:52.474399 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-34e99606-2af2-409b-a6e6-3c282b11a59b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:52.475941 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-34e99606-2af2-409b-a6e6-3c282b11a59b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:52.478047 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-34e99606-2af2-409b-a6e6-3c282b11a59b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1724 microversion: 2.20 time: 0.215254 Dec 15 13:34:52.489192 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 359/707] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:34:52 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1724 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:34:52.746656 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-055e1c5d-126e-4d3e-bed0-6dd0b23c4cd6 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:52.748282 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-055e1c5d-126e-4d3e-bed0-6dd0b23c4cd6 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:52.756920 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-055e1c5d-126e-4d3e-bed0-6dd0b23c4cd6 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:52.757711 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-055e1c5d-126e-4d3e-bed0-6dd0b23c4cd6 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:52.758679 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-055e1c5d-126e-4d3e-bed0-6dd0b23c4cd6 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:52.759310 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-055e1c5d-126e-4d3e-bed0-6dd0b23c4cd6 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:52.908961 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-055e1c5d-126e-4d3e-bed0-6dd0b23c4cd6 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:52.917148 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-055e1c5d-126e-4d3e-bed0-6dd0b23c4cd6 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1724 microversion: 2.1 time: 0.175449 Dec 15 13:34:52.919036 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 349/708] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:52 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:34:53.496397 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-8a2eafaa-457e-4bca-adbe-878ea7fa2870 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:53.498722 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-8a2eafaa-457e-4bca-adbe-878ea7fa2870 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:53.510646 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8a2eafaa-457e-4bca-adbe-878ea7fa2870 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:53.510646 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8a2eafaa-457e-4bca-adbe-878ea7fa2870 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:53.511382 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8a2eafaa-457e-4bca-adbe-878ea7fa2870 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:53.512059 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8a2eafaa-457e-4bca-adbe-878ea7fa2870 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:53.683685 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-8a2eafaa-457e-4bca-adbe-878ea7fa2870 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:53.699084 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-8a2eafaa-457e-4bca-adbe-878ea7fa2870 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:53.700678 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-8a2eafaa-457e-4bca-adbe-878ea7fa2870 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:53.703936 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-8a2eafaa-457e-4bca-adbe-878ea7fa2870 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1724 microversion: 2.20 time: 0.211236 Dec 15 13:34:53.704917 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 360/709] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:34:53 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1724 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:34:53.938533 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-e710a149-9cdd-477a-aa95-9474dc000908 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:53.940577 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-e710a149-9cdd-477a-aa95-9474dc000908 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:53.955856 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e710a149-9cdd-477a-aa95-9474dc000908 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:53.956858 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e710a149-9cdd-477a-aa95-9474dc000908 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:53.957997 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e710a149-9cdd-477a-aa95-9474dc000908 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:53.958594 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e710a149-9cdd-477a-aa95-9474dc000908 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:54.167825 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-e710a149-9cdd-477a-aa95-9474dc000908 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:54.176363 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-e710a149-9cdd-477a-aa95-9474dc000908 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1724 microversion: 2.1 time: 0.244227 Dec 15 13:34:54.186111 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 350/710] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:53 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1724 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:34:54.726356 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-9d47cc2d-e5ee-4479-89b7-08f9beda946c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:54.727642 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-9d47cc2d-e5ee-4479-89b7-08f9beda946c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:54.736068 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9d47cc2d-e5ee-4479-89b7-08f9beda946c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:54.736845 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9d47cc2d-e5ee-4479-89b7-08f9beda946c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:54.737969 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9d47cc2d-e5ee-4479-89b7-08f9beda946c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:54.738572 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9d47cc2d-e5ee-4479-89b7-08f9beda946c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:54.873649 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-9d47cc2d-e5ee-4479-89b7-08f9beda946c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:54.881721 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-9d47cc2d-e5ee-4479-89b7-08f9beda946c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:54.883315 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-9d47cc2d-e5ee-4479-89b7-08f9beda946c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:54.884593 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-9d47cc2d-e5ee-4479-89b7-08f9beda946c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1724 microversion: 2.20 time: 0.162390 Dec 15 13:34:54.885258 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 361/711] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:34:54 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:34:55.193683 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-d13f2285-d0e8-4b66-bfc2-16498c3357b5 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:55.194293 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-d13f2285-d0e8-4b66-bfc2-16498c3357b5 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:55.201291 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d13f2285-d0e8-4b66-bfc2-16498c3357b5 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:55.201741 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d13f2285-d0e8-4b66-bfc2-16498c3357b5 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:55.202516 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d13f2285-d0e8-4b66-bfc2-16498c3357b5 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:55.202979 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d13f2285-d0e8-4b66-bfc2-16498c3357b5 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:55.338546 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-d13f2285-d0e8-4b66-bfc2-16498c3357b5 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:55.347122 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-d13f2285-d0e8-4b66-bfc2-16498c3357b5 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1724 microversion: 2.1 time: 0.157447 Dec 15 13:34:55.347791 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 351/712] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:55 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:34:55.903280 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-45aab83e-1193-47bf-8873-b889da279b94 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:55.903899 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-45aab83e-1193-47bf-8873-b889da279b94 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:55.910397 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-45aab83e-1193-47bf-8873-b889da279b94 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:55.911075 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-45aab83e-1193-47bf-8873-b889da279b94 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:55.911889 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-45aab83e-1193-47bf-8873-b889da279b94 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:55.912332 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-45aab83e-1193-47bf-8873-b889da279b94 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:56.115760 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-45aab83e-1193-47bf-8873-b889da279b94 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:56.130584 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-45aab83e-1193-47bf-8873-b889da279b94 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:56.132510 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-45aab83e-1193-47bf-8873-b889da279b94 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:56.133878 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-45aab83e-1193-47bf-8873-b889da279b94 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1724 microversion: 2.20 time: 0.234882 Dec 15 13:34:56.134662 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 362/713] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:34:55 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1724 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:34:56.368188 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-c10e0bbd-5329-4451-ab74-f655d8959297 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:56.368794 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-c10e0bbd-5329-4451-ab74-f655d8959297 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:56.375690 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c10e0bbd-5329-4451-ab74-f655d8959297 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:56.376266 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c10e0bbd-5329-4451-ab74-f655d8959297 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:56.377078 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c10e0bbd-5329-4451-ab74-f655d8959297 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:56.377529 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c10e0bbd-5329-4451-ab74-f655d8959297 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:56.551888 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-c10e0bbd-5329-4451-ab74-f655d8959297 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:56.566776 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-c10e0bbd-5329-4451-ab74-f655d8959297 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1724 microversion: 2.1 time: 0.206250 Dec 15 13:34:56.567550 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 352/714] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:56 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1724 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:34:57.152111 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-7eb134d8-943b-405b-bde8-67dd030c9745 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:57.152731 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-7eb134d8-943b-405b-bde8-67dd030c9745 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:57.164113 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7eb134d8-943b-405b-bde8-67dd030c9745 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:57.165091 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7eb134d8-943b-405b-bde8-67dd030c9745 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:57.166131 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7eb134d8-943b-405b-bde8-67dd030c9745 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:57.167331 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7eb134d8-943b-405b-bde8-67dd030c9745 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:57.405288 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-7eb134d8-943b-405b-bde8-67dd030c9745 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:57.418763 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-7eb134d8-943b-405b-bde8-67dd030c9745 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:57.420682 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-7eb134d8-943b-405b-bde8-67dd030c9745 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:57.422333 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-7eb134d8-943b-405b-bde8-67dd030c9745 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1724 microversion: 2.20 time: 0.273976 Dec 15 13:34:57.422920 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 363/715] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:34:57 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1724 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:34:57.586091 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-95ec3f1d-6516-4b7b-8856-b4233432358d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:57.586757 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-95ec3f1d-6516-4b7b-8856-b4233432358d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:57.595167 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-95ec3f1d-6516-4b7b-8856-b4233432358d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:57.595845 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-95ec3f1d-6516-4b7b-8856-b4233432358d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:57.597910 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-95ec3f1d-6516-4b7b-8856-b4233432358d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:57.599266 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-95ec3f1d-6516-4b7b-8856-b4233432358d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:57.786418 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-95ec3f1d-6516-4b7b-8856-b4233432358d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:57.795656 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-95ec3f1d-6516-4b7b-8856-b4233432358d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1724 microversion: 2.1 time: 0.214150 Dec 15 13:34:57.805353 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 353/716] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:57 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1724 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:34:58.440172 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-26d4199a-6039-4f73-9aa0-7e2ba9e80c8d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:58.441933 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-26d4199a-6039-4f73-9aa0-7e2ba9e80c8d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:58.449494 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-26d4199a-6039-4f73-9aa0-7e2ba9e80c8d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:58.450669 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-26d4199a-6039-4f73-9aa0-7e2ba9e80c8d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:58.452024 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-26d4199a-6039-4f73-9aa0-7e2ba9e80c8d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:58.452810 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-26d4199a-6039-4f73-9aa0-7e2ba9e80c8d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:58.604764 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-26d4199a-6039-4f73-9aa0-7e2ba9e80c8d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:58.619229 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-26d4199a-6039-4f73-9aa0-7e2ba9e80c8d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:58.621630 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-26d4199a-6039-4f73-9aa0-7e2ba9e80c8d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:58.623150 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-26d4199a-6039-4f73-9aa0-7e2ba9e80c8d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1745 microversion: 2.20 time: 0.186577 Dec 15 13:34:58.624234 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 364/717] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:34:58 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1745 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:34:58.813170 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-6719d882-ca8a-4430-8a85-a13e55cd3efe tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:58.813793 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-6719d882-ca8a-4430-8a85-a13e55cd3efe tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:58.826208 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6719d882-ca8a-4430-8a85-a13e55cd3efe tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:58.827112 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6719d882-ca8a-4430-8a85-a13e55cd3efe tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:58.828235 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6719d882-ca8a-4430-8a85-a13e55cd3efe tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:58.828820 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6719d882-ca8a-4430-8a85-a13e55cd3efe tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:59.020376 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-6719d882-ca8a-4430-8a85-a13e55cd3efe tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:59.033177 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-6719d882-ca8a-4430-8a85-a13e55cd3efe tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1724 microversion: 2.1 time: 0.223676 Dec 15 13:34:59.034047 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 354/718] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:34:58 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1724 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:34:59.641905 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-b1a80a9a-54b4-4eb4-afa9-4f46a29a92cf tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:59.642781 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-b1a80a9a-54b4-4eb4-afa9-4f46a29a92cf tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:34:59.649418 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b1a80a9a-54b4-4eb4-afa9-4f46a29a92cf tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:59.651454 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b1a80a9a-54b4-4eb4-afa9-4f46a29a92cf tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:59.653290 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b1a80a9a-54b4-4eb4-afa9-4f46a29a92cf tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:59.653778 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b1a80a9a-54b4-4eb4-afa9-4f46a29a92cf tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:59.829455 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-b1a80a9a-54b4-4eb4-afa9-4f46a29a92cf tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:59.837584 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-b1a80a9a-54b4-4eb4-afa9-4f46a29a92cf tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:59.839163 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-b1a80a9a-54b4-4eb4-afa9-4f46a29a92cf tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:34:59.840340 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-b1a80a9a-54b4-4eb4-afa9-4f46a29a92cf tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1745 microversion: 2.20 time: 0.202194 Dec 15 13:34:59.840921 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 365/719] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:34:59 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1745 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:35:00.055289 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-a1c465bf-77da-4c3f-9702-3e99461927ae tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:00.056529 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-a1c465bf-77da-4c3f-9702-3e99461927ae tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:00.068100 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a1c465bf-77da-4c3f-9702-3e99461927ae tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:00.069473 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a1c465bf-77da-4c3f-9702-3e99461927ae tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:00.071922 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a1c465bf-77da-4c3f-9702-3e99461927ae tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:00.072531 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a1c465bf-77da-4c3f-9702-3e99461927ae tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:00.266160 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-a1c465bf-77da-4c3f-9702-3e99461927ae tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:00.278241 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-a1c465bf-77da-4c3f-9702-3e99461927ae tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1724 microversion: 2.1 time: 0.228407 Dec 15 13:35:00.290261 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 355/720] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:35:00 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1724 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:35:00.862380 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-64a4acee-119d-4e57-9b8d-c81f24faa595 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:00.864655 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-64a4acee-119d-4e57-9b8d-c81f24faa595 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:00.873746 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-64a4acee-119d-4e57-9b8d-c81f24faa595 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:00.875060 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-64a4acee-119d-4e57-9b8d-c81f24faa595 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:00.876442 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-64a4acee-119d-4e57-9b8d-c81f24faa595 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:00.877753 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-64a4acee-119d-4e57-9b8d-c81f24faa595 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:01.067651 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-64a4acee-119d-4e57-9b8d-c81f24faa595 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:01.084038 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-64a4acee-119d-4e57-9b8d-c81f24faa595 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:01.086618 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-64a4acee-119d-4e57-9b8d-c81f24faa595 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:01.088412 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-64a4acee-119d-4e57-9b8d-c81f24faa595 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1745 microversion: 2.20 time: 0.231056 Dec 15 13:35:01.089010 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 366/721] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:35:00 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1745 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:35:01.299035 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-2cc1cccf-9eef-4248-a4df-e619d8dbc421 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:01.300311 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-2cc1cccf-9eef-4248-a4df-e619d8dbc421 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:01.310633 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2cc1cccf-9eef-4248-a4df-e619d8dbc421 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:01.311519 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2cc1cccf-9eef-4248-a4df-e619d8dbc421 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:01.312950 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2cc1cccf-9eef-4248-a4df-e619d8dbc421 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:01.313762 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2cc1cccf-9eef-4248-a4df-e619d8dbc421 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:01.498706 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-2cc1cccf-9eef-4248-a4df-e619d8dbc421 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:01.509744 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-2cc1cccf-9eef-4248-a4df-e619d8dbc421 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1724 microversion: 2.1 time: 0.215278 Dec 15 13:35:01.523017 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 356/722] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:35:01 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1724 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:35:02.108805 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-406441e7-ff78-4aa2-aa0d-c9dbc7abd633 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:02.110256 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-406441e7-ff78-4aa2-aa0d-c9dbc7abd633 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:02.116922 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-406441e7-ff78-4aa2-aa0d-c9dbc7abd633 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:02.117787 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-406441e7-ff78-4aa2-aa0d-c9dbc7abd633 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:02.118755 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-406441e7-ff78-4aa2-aa0d-c9dbc7abd633 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:02.122248 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-406441e7-ff78-4aa2-aa0d-c9dbc7abd633 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:02.278737 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-406441e7-ff78-4aa2-aa0d-c9dbc7abd633 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:02.287716 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-406441e7-ff78-4aa2-aa0d-c9dbc7abd633 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:02.289847 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-406441e7-ff78-4aa2-aa0d-c9dbc7abd633 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:02.291444 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-406441e7-ff78-4aa2-aa0d-c9dbc7abd633 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1745 microversion: 2.20 time: 0.188163 Dec 15 13:35:02.292463 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 367/723] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:35:02 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1745 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:35:02.534901 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-27571edc-352d-4de2-b9ca-f5ef74b5f456 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:02.536043 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-27571edc-352d-4de2-b9ca-f5ef74b5f456 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:02.549517 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-27571edc-352d-4de2-b9ca-f5ef74b5f456 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:02.554937 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-27571edc-352d-4de2-b9ca-f5ef74b5f456 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:02.556352 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-27571edc-352d-4de2-b9ca-f5ef74b5f456 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:02.557713 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-27571edc-352d-4de2-b9ca-f5ef74b5f456 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:02.902280 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-27571edc-352d-4de2-b9ca-f5ef74b5f456 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:02.913688 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-27571edc-352d-4de2-b9ca-f5ef74b5f456 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1724 microversion: 2.1 time: 0.382170 Dec 15 13:35:02.914871 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 357/724] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:35:02 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1724 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:35:03.313064 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-b62ba5a2-3384-449a-838e-8847a6c8eed0 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:03.313907 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-b62ba5a2-3384-449a-838e-8847a6c8eed0 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:03.335225 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b62ba5a2-3384-449a-838e-8847a6c8eed0 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:03.335688 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b62ba5a2-3384-449a-838e-8847a6c8eed0 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:03.336635 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b62ba5a2-3384-449a-838e-8847a6c8eed0 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:03.337111 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b62ba5a2-3384-449a-838e-8847a6c8eed0 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:03.590709 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-b62ba5a2-3384-449a-838e-8847a6c8eed0 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:03.616264 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-b62ba5a2-3384-449a-838e-8847a6c8eed0 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:03.618115 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-b62ba5a2-3384-449a-838e-8847a6c8eed0 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:03.619509 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-b62ba5a2-3384-449a-838e-8847a6c8eed0 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1745 microversion: 2.20 time: 0.312967 Dec 15 13:35:03.620354 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 368/725] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:35:03 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1745 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:35:03.931621 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-2ee38ccb-3db4-488b-9951-6ef7081b0819 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:03.933011 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-2ee38ccb-3db4-488b-9951-6ef7081b0819 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:03.939608 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2ee38ccb-3db4-488b-9951-6ef7081b0819 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:03.940144 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2ee38ccb-3db4-488b-9951-6ef7081b0819 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:03.941033 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2ee38ccb-3db4-488b-9951-6ef7081b0819 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:03.941552 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2ee38ccb-3db4-488b-9951-6ef7081b0819 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:04.128027 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-2ee38ccb-3db4-488b-9951-6ef7081b0819 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:04.136784 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-2ee38ccb-3db4-488b-9951-6ef7081b0819 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1724 microversion: 2.1 time: 0.208868 Dec 15 13:35:04.138017 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 358/726] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:35:03 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1724 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:35:04.641772 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-8fd47d49-99ac-42bd-9775-90f1dfa81911 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:04.642726 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-8fd47d49-99ac-42bd-9775-90f1dfa81911 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:04.649353 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8fd47d49-99ac-42bd-9775-90f1dfa81911 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:04.649894 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8fd47d49-99ac-42bd-9775-90f1dfa81911 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:04.651516 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8fd47d49-99ac-42bd-9775-90f1dfa81911 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:04.652201 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8fd47d49-99ac-42bd-9775-90f1dfa81911 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:04.849793 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-8fd47d49-99ac-42bd-9775-90f1dfa81911 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:04.860717 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-8fd47d49-99ac-42bd-9775-90f1dfa81911 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:04.863269 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-8fd47d49-99ac-42bd-9775-90f1dfa81911 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:04.865026 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-8fd47d49-99ac-42bd-9775-90f1dfa81911 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1745 microversion: 2.20 time: 0.227376 Dec 15 13:35:04.866448 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 369/727] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:35:04 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1745 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:35:05.154856 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-4aec16bd-6a25-42ff-931c-fff976481549 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:05.155554 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-4aec16bd-6a25-42ff-931c-fff976481549 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:05.163200 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4aec16bd-6a25-42ff-931c-fff976481549 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:05.163670 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4aec16bd-6a25-42ff-931c-fff976481549 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:05.164480 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4aec16bd-6a25-42ff-931c-fff976481549 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:05.164959 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4aec16bd-6a25-42ff-931c-fff976481549 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:05.311334 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-4aec16bd-6a25-42ff-931c-fff976481549 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:05.321595 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-4aec16bd-6a25-42ff-931c-fff976481549 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1724 microversion: 2.1 time: 0.170920 Dec 15 13:35:05.323916 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 359/728] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:35:05 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:35:05.885421 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-7924058b-e411-4fbe-b0d5-aae266c491ae tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:05.887817 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-7924058b-e411-4fbe-b0d5-aae266c491ae tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:05.894865 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7924058b-e411-4fbe-b0d5-aae266c491ae tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:05.895358 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7924058b-e411-4fbe-b0d5-aae266c491ae tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:05.896341 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7924058b-e411-4fbe-b0d5-aae266c491ae tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:05.896788 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7924058b-e411-4fbe-b0d5-aae266c491ae tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:06.047463 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-7924058b-e411-4fbe-b0d5-aae266c491ae tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:06.055744 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-7924058b-e411-4fbe-b0d5-aae266c491ae tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:06.057339 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-7924058b-e411-4fbe-b0d5-aae266c491ae tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:06.058620 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-7924058b-e411-4fbe-b0d5-aae266c491ae tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1745 microversion: 2.20 time: 0.177697 Dec 15 13:35:06.059447 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 370/729] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:35:05 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1745 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:35:06.342384 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-b37b8d8c-c1ff-4729-8bcf-097d60fb8034 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:06.343623 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-b37b8d8c-c1ff-4729-8bcf-097d60fb8034 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:06.358644 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b37b8d8c-c1ff-4729-8bcf-097d60fb8034 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:06.359504 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b37b8d8c-c1ff-4729-8bcf-097d60fb8034 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:06.361207 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b37b8d8c-c1ff-4729-8bcf-097d60fb8034 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:06.361727 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b37b8d8c-c1ff-4729-8bcf-097d60fb8034 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:06.437949 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-a18f297e-735f-4316-b8ba-db65a7c209e1 req-e6ea8da2-dcee-4c4e-82fe-fa8dd20108b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00671676-47cb-4266-b9e5-61c7fb120355", "name": "network-vif-plugged", "status": "completed", "tag": "33030795-e868-427d-8a6a-6d48523668bc"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:35:06.439708 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:35:06.439708 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: warnings.warn(msg) Dec 15 13:35:06.452818 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-a18f297e-735f-4316-b8ba-db65a7c209e1 req-e6ea8da2-dcee-4c4e-82fe-fa8dd20108b8 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:06.453621 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-a18f297e-735f-4316-b8ba-db65a7c209e1 req-e6ea8da2-dcee-4c4e-82fe-fa8dd20108b8 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:06.467018 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-a18f297e-735f-4316-b8ba-db65a7c209e1 req-e6ea8da2-dcee-4c4e-82fe-fa8dd20108b8 service nova] Creating event network-vif-plugged:33030795-e868-427d-8a6a-6d48523668bc for instance 00671676-47cb-4266-b9e5-61c7fb120355 on hv-cinder-81322 Dec 15 13:35:06.472703 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-a18f297e-735f-4316-b8ba-db65a7c209e1 req-e6ea8da2-dcee-4c4e-82fe-fa8dd20108b8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038329 Dec 15 13:35:06.473622 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 371/730] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:35:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:35:06.522351 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-b37b8d8c-c1ff-4729-8bcf-097d60fb8034 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:06.530906 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-b37b8d8c-c1ff-4729-8bcf-097d60fb8034 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1724 microversion: 2.1 time: 0.194059 Dec 15 13:35:06.531497 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 360/731] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:35:06 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1724 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:35:07.082713 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-be79e370-e7a6-4892-89f0-a8b502ea5af2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:07.083716 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-be79e370-e7a6-4892-89f0-a8b502ea5af2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:07.092367 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-be79e370-e7a6-4892-89f0-a8b502ea5af2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:07.092922 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-be79e370-e7a6-4892-89f0-a8b502ea5af2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:07.093927 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-be79e370-e7a6-4892-89f0-a8b502ea5af2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:07.094483 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-be79e370-e7a6-4892-89f0-a8b502ea5af2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:07.243328 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-be79e370-e7a6-4892-89f0-a8b502ea5af2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:07.252394 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-be79e370-e7a6-4892-89f0-a8b502ea5af2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:07.254483 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-be79e370-e7a6-4892-89f0-a8b502ea5af2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:07.256084 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-be79e370-e7a6-4892-89f0-a8b502ea5af2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1740 microversion: 2.20 time: 0.179606 Dec 15 13:35:07.256834 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 372/732] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:35:07 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1740 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:35:07.552449 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-02f240fc-6149-4ac9-b02e-d86a40a2a3de tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:07.553883 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-02f240fc-6149-4ac9-b02e-d86a40a2a3de tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:07.560472 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-02f240fc-6149-4ac9-b02e-d86a40a2a3de tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:07.561240 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-02f240fc-6149-4ac9-b02e-d86a40a2a3de tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:07.562119 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-02f240fc-6149-4ac9-b02e-d86a40a2a3de tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:07.562634 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-02f240fc-6149-4ac9-b02e-d86a40a2a3de tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:07.710911 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-02f240fc-6149-4ac9-b02e-d86a40a2a3de tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:07.722053 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-02f240fc-6149-4ac9-b02e-d86a40a2a3de tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1724 microversion: 2.1 time: 0.173159 Dec 15 13:35:07.732109 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 361/733] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:35:07 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:35:08.274711 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-2d0f504d-e375-4b8b-86e7-90e95a8de891 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:08.275379 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-2d0f504d-e375-4b8b-86e7-90e95a8de891 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:08.282221 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2d0f504d-e375-4b8b-86e7-90e95a8de891 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:08.282933 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2d0f504d-e375-4b8b-86e7-90e95a8de891 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:08.283927 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2d0f504d-e375-4b8b-86e7-90e95a8de891 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:08.284543 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2d0f504d-e375-4b8b-86e7-90e95a8de891 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:08.432136 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-2d0f504d-e375-4b8b-86e7-90e95a8de891 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:08.440448 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-2d0f504d-e375-4b8b-86e7-90e95a8de891 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:08.441961 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-2d0f504d-e375-4b8b-86e7-90e95a8de891 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:08.443176 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-2d0f504d-e375-4b8b-86e7-90e95a8de891 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1740 microversion: 2.20 time: 0.172311 Dec 15 13:35:08.443766 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 373/734] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:35:08 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1740 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:35:08.740256 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-5c577545-2a2c-4b27-ab20-c6d2bcd2b99a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:08.741006 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-5c577545-2a2c-4b27-ab20-c6d2bcd2b99a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:08.747783 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5c577545-2a2c-4b27-ab20-c6d2bcd2b99a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:08.748170 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5c577545-2a2c-4b27-ab20-c6d2bcd2b99a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:08.748956 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5c577545-2a2c-4b27-ab20-c6d2bcd2b99a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:08.749397 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5c577545-2a2c-4b27-ab20-c6d2bcd2b99a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:08.873787 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-5c577545-2a2c-4b27-ab20-c6d2bcd2b99a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:08.881493 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-5c577545-2a2c-4b27-ab20-c6d2bcd2b99a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1724 microversion: 2.1 time: 0.144946 Dec 15 13:35:08.882071 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 362/735] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:35:08 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1724 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:35:09.462110 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-2aced8d5-8dd5-4de9-9e20-aeb820c04e01 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:09.463281 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-2aced8d5-8dd5-4de9-9e20-aeb820c04e01 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:09.469562 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2aced8d5-8dd5-4de9-9e20-aeb820c04e01 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:09.470025 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2aced8d5-8dd5-4de9-9e20-aeb820c04e01 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:09.470810 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2aced8d5-8dd5-4de9-9e20-aeb820c04e01 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:09.471282 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2aced8d5-8dd5-4de9-9e20-aeb820c04e01 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:09.784478 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-2aced8d5-8dd5-4de9-9e20-aeb820c04e01 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:09.792252 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-2aced8d5-8dd5-4de9-9e20-aeb820c04e01 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:09.793757 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-2aced8d5-8dd5-4de9-9e20-aeb820c04e01 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:09.794938 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-2aced8d5-8dd5-4de9-9e20-aeb820c04e01 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1740 microversion: 2.20 time: 0.336542 Dec 15 13:35:09.795513 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 374/736] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:35:09 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1740 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:35:09.898306 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-48de8af0-311f-4727-baa9-b0b672951528 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:09.898930 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-48de8af0-311f-4727-baa9-b0b672951528 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:09.905806 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-48de8af0-311f-4727-baa9-b0b672951528 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:09.906263 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-48de8af0-311f-4727-baa9-b0b672951528 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:09.907079 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-48de8af0-311f-4727-baa9-b0b672951528 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:09.907548 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-48de8af0-311f-4727-baa9-b0b672951528 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:10.035888 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-48de8af0-311f-4727-baa9-b0b672951528 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:10.043588 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-48de8af0-311f-4727-baa9-b0b672951528 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1724 microversion: 2.1 time: 0.148986 Dec 15 13:35:10.044161 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 363/737] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:35:09 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:35:10.813112 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ed48d0d6-4eb2-4a26-8b69-3c99e67dd3cb tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:10.813758 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ed48d0d6-4eb2-4a26-8b69-3c99e67dd3cb tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:10.820203 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ed48d0d6-4eb2-4a26-8b69-3c99e67dd3cb tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:10.820660 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ed48d0d6-4eb2-4a26-8b69-3c99e67dd3cb tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:10.821438 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ed48d0d6-4eb2-4a26-8b69-3c99e67dd3cb tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:10.821877 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ed48d0d6-4eb2-4a26-8b69-3c99e67dd3cb tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:10.950751 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-ed48d0d6-4eb2-4a26-8b69-3c99e67dd3cb tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:10.958395 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-ed48d0d6-4eb2-4a26-8b69-3c99e67dd3cb tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:10.959897 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-ed48d0d6-4eb2-4a26-8b69-3c99e67dd3cb tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:10.961040 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ed48d0d6-4eb2-4a26-8b69-3c99e67dd3cb tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1740 microversion: 2.20 time: 0.151612 Dec 15 13:35:10.961603 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 375/738] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:35:10 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1740 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:35:11.060374 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-cec7325a-1c3a-48be-92b7-0032e3bd7129 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:11.060988 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-cec7325a-1c3a-48be-92b7-0032e3bd7129 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:11.067313 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cec7325a-1c3a-48be-92b7-0032e3bd7129 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:11.067773 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cec7325a-1c3a-48be-92b7-0032e3bd7129 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:11.068559 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cec7325a-1c3a-48be-92b7-0032e3bd7129 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:11.069005 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cec7325a-1c3a-48be-92b7-0032e3bd7129 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:11.202408 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-cec7325a-1c3a-48be-92b7-0032e3bd7129 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:11.210514 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-cec7325a-1c3a-48be-92b7-0032e3bd7129 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1724 microversion: 2.1 time: 0.153857 Dec 15 13:35:11.211120 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 364/739] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:35:11 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:35:11.979373 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-206ae7e8-0ade-488f-8243-0184ec4fcc5a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:11.979983 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-206ae7e8-0ade-488f-8243-0184ec4fcc5a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:11.986203 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-206ae7e8-0ade-488f-8243-0184ec4fcc5a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:11.986685 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-206ae7e8-0ade-488f-8243-0184ec4fcc5a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:11.987486 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-206ae7e8-0ade-488f-8243-0184ec4fcc5a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:11.987940 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-206ae7e8-0ade-488f-8243-0184ec4fcc5a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:12.115953 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-206ae7e8-0ade-488f-8243-0184ec4fcc5a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:12.123705 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-206ae7e8-0ade-488f-8243-0184ec4fcc5a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:12.125194 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-206ae7e8-0ade-488f-8243-0184ec4fcc5a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:12.126340 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-206ae7e8-0ade-488f-8243-0184ec4fcc5a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1740 microversion: 2.20 time: 0.150650 Dec 15 13:35:12.126927 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 376/740] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:35:11 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1740 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:35:12.228042 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-47ba809a-f0e8-45b5-8b5b-8bbb2e2df649 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:12.228722 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-47ba809a-f0e8-45b5-8b5b-8bbb2e2df649 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:12.235078 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-47ba809a-f0e8-45b5-8b5b-8bbb2e2df649 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:12.235536 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-47ba809a-f0e8-45b5-8b5b-8bbb2e2df649 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:12.236328 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-47ba809a-f0e8-45b5-8b5b-8bbb2e2df649 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:12.236774 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-47ba809a-f0e8-45b5-8b5b-8bbb2e2df649 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:12.364497 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-47ba809a-f0e8-45b5-8b5b-8bbb2e2df649 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:12.372723 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-47ba809a-f0e8-45b5-8b5b-8bbb2e2df649 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1724 microversion: 2.1 time: 0.148315 Dec 15 13:35:12.373301 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 365/741] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:35:12 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:35:13.144413 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-de9d9897-e99b-4584-baa0-878d08367156 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:13.145023 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-de9d9897-e99b-4584-baa0-878d08367156 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:13.151773 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-de9d9897-e99b-4584-baa0-878d08367156 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:13.152221 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-de9d9897-e99b-4584-baa0-878d08367156 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:13.152992 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-de9d9897-e99b-4584-baa0-878d08367156 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:13.153425 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-de9d9897-e99b-4584-baa0-878d08367156 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:13.283767 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-de9d9897-e99b-4584-baa0-878d08367156 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:13.292115 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-de9d9897-e99b-4584-baa0-878d08367156 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:13.293656 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-de9d9897-e99b-4584-baa0-878d08367156 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:13.294874 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-de9d9897-e99b-4584-baa0-878d08367156 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1740 microversion: 2.20 time: 0.154140 Dec 15 13:35:13.295457 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 377/742] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:35:13 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1740 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:35:13.389028 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-6e89c4ad-ba1a-48a2-8486-8942bc2c5e6c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:13.389643 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-6e89c4ad-ba1a-48a2-8486-8942bc2c5e6c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:13.396154 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6e89c4ad-ba1a-48a2-8486-8942bc2c5e6c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:13.396559 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6e89c4ad-ba1a-48a2-8486-8942bc2c5e6c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:13.397341 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6e89c4ad-ba1a-48a2-8486-8942bc2c5e6c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:13.397783 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6e89c4ad-ba1a-48a2-8486-8942bc2c5e6c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:13.536615 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-6e89c4ad-ba1a-48a2-8486-8942bc2c5e6c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:13.554467 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-6e89c4ad-ba1a-48a2-8486-8942bc2c5e6c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1724 microversion: 2.1 time: 0.168923 Dec 15 13:35:13.556075 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 366/743] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:35:13 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:35:14.313470 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-25587843-755d-44b7-9a01-4c38542e8d13 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:14.315095 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-25587843-755d-44b7-9a01-4c38542e8d13 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:14.322451 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-25587843-755d-44b7-9a01-4c38542e8d13 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:14.323034 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-25587843-755d-44b7-9a01-4c38542e8d13 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:14.323929 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-25587843-755d-44b7-9a01-4c38542e8d13 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:14.324608 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-25587843-755d-44b7-9a01-4c38542e8d13 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:14.486116 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-25587843-755d-44b7-9a01-4c38542e8d13 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:14.496502 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-25587843-755d-44b7-9a01-4c38542e8d13 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:14.498180 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-25587843-755d-44b7-9a01-4c38542e8d13 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:14.499398 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-25587843-755d-44b7-9a01-4c38542e8d13 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1740 microversion: 2.20 time: 0.190209 Dec 15 13:35:14.500137 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 378/744] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:35:14 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1740 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:35:14.574079 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-b51bb03a-b648-42f8-9fb2-f4b209cc2d2f tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:14.574734 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-b51bb03a-b648-42f8-9fb2-f4b209cc2d2f tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:14.581340 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b51bb03a-b648-42f8-9fb2-f4b209cc2d2f tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:14.581805 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b51bb03a-b648-42f8-9fb2-f4b209cc2d2f tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:14.582611 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b51bb03a-b648-42f8-9fb2-f4b209cc2d2f tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:14.583123 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b51bb03a-b648-42f8-9fb2-f4b209cc2d2f tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:14.759185 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-b51bb03a-b648-42f8-9fb2-f4b209cc2d2f tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:14.768002 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-b51bb03a-b648-42f8-9fb2-f4b209cc2d2f tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1701 microversion: 2.1 time: 0.199305 Dec 15 13:35:14.768592 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 367/745] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:35:14 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1701 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:35:14.784228 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-e4b9d456-2671-48d9-9a19-1c3b3492cb29 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:35:14.790079 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e4b9d456-2671-48d9-9a19-1c3b3492cb29 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:14.790533 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e4b9d456-2671-48d9-9a19-1c3b3492cb29 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:14.854278 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-e4b9d456-2671-48d9-9a19-1c3b3492cb29 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Going to try to start instance {{(pid=116942) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 15 13:35:14.937282 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-e4b9d456-2671-48d9-9a19-1c3b3492cb29 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 202 len: 0 microversion: 2.1 time: 0.156570 Dec 15 13:35:14.938189 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 379/746] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:35:14 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:35:14.949058 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-6e4636ba-fa0f-4e53-b848-fe55401c38fc tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:14.952403 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-6e4636ba-fa0f-4e53-b848-fe55401c38fc tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:14.960560 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6e4636ba-fa0f-4e53-b848-fe55401c38fc tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:14.961015 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6e4636ba-fa0f-4e53-b848-fe55401c38fc tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:14.961843 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6e4636ba-fa0f-4e53-b848-fe55401c38fc tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:14.962588 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6e4636ba-fa0f-4e53-b848-fe55401c38fc tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:15.232616 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-6e4636ba-fa0f-4e53-b848-fe55401c38fc tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:15.247524 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-6e4636ba-fa0f-4e53-b848-fe55401c38fc tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1710 microversion: 2.1 time: 0.301430 Dec 15 13:35:15.248606 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 368/747] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:35:14 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1710 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:35:15.520682 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-df08a5f7-ed0a-463c-881b-80bfb7d19202 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:15.521401 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-df08a5f7-ed0a-463c-881b-80bfb7d19202 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:15.529333 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-df08a5f7-ed0a-463c-881b-80bfb7d19202 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:15.529793 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-df08a5f7-ed0a-463c-881b-80bfb7d19202 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:15.530790 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-df08a5f7-ed0a-463c-881b-80bfb7d19202 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:15.531410 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-df08a5f7-ed0a-463c-881b-80bfb7d19202 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:15.699836 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-df08a5f7-ed0a-463c-881b-80bfb7d19202 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:15.714251 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-df08a5f7-ed0a-463c-881b-80bfb7d19202 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:15.715817 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-df08a5f7-ed0a-463c-881b-80bfb7d19202 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:15.717025 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-df08a5f7-ed0a-463c-881b-80bfb7d19202 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1740 microversion: 2.20 time: 0.202006 Dec 15 13:35:15.717604 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 380/748] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:35:15 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1740 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:35:16.266620 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-2bd9e475-3ace-4040-b06c-589433f3e013 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:16.268219 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-2bd9e475-3ace-4040-b06c-589433f3e013 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:16.275217 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2bd9e475-3ace-4040-b06c-589433f3e013 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:16.275927 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2bd9e475-3ace-4040-b06c-589433f3e013 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:16.276996 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2bd9e475-3ace-4040-b06c-589433f3e013 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:16.278447 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2bd9e475-3ace-4040-b06c-589433f3e013 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:16.467984 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-2bd9e475-3ace-4040-b06c-589433f3e013 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:16.476639 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-2bd9e475-3ace-4040-b06c-589433f3e013 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1710 microversion: 2.1 time: 0.214721 Dec 15 13:35:16.488185 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 369/749] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:35:16 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1710 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:35:16.734970 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-2f370355-c7f0-4204-9f69-79f1f4cc5a1c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:16.743217 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-2f370355-c7f0-4204-9f69-79f1f4cc5a1c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:16.750771 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2f370355-c7f0-4204-9f69-79f1f4cc5a1c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:16.751533 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2f370355-c7f0-4204-9f69-79f1f4cc5a1c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:16.752413 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2f370355-c7f0-4204-9f69-79f1f4cc5a1c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:16.753000 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2f370355-c7f0-4204-9f69-79f1f4cc5a1c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:17.000865 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-2f370355-c7f0-4204-9f69-79f1f4cc5a1c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:17.009742 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-2f370355-c7f0-4204-9f69-79f1f4cc5a1c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:17.011653 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-2f370355-c7f0-4204-9f69-79f1f4cc5a1c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:17.013254 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-2f370355-c7f0-4204-9f69-79f1f4cc5a1c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1740 microversion: 2.20 time: 0.281879 Dec 15 13:35:17.024317 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 381/750] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:35:16 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1740 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:35:17.500074 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-afda2895-6a34-4a2a-8f84-22bac29723b3 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:17.501433 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-afda2895-6a34-4a2a-8f84-22bac29723b3 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:17.507907 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-afda2895-6a34-4a2a-8f84-22bac29723b3 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:17.508706 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-afda2895-6a34-4a2a-8f84-22bac29723b3 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:17.512686 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-afda2895-6a34-4a2a-8f84-22bac29723b3 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:17.513406 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-afda2895-6a34-4a2a-8f84-22bac29723b3 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:17.674143 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-afda2895-6a34-4a2a-8f84-22bac29723b3 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:17.683836 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-afda2895-6a34-4a2a-8f84-22bac29723b3 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1714 microversion: 2.1 time: 0.187582 Dec 15 13:35:17.684729 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 370/751] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:35:17 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1714 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:35:18.036488 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-9e98125e-0cdd-41e2-ae4f-3c0424e6ab36 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:18.038118 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-9e98125e-0cdd-41e2-ae4f-3c0424e6ab36 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:18.045263 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9e98125e-0cdd-41e2-ae4f-3c0424e6ab36 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:18.046159 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9e98125e-0cdd-41e2-ae4f-3c0424e6ab36 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:18.047177 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9e98125e-0cdd-41e2-ae4f-3c0424e6ab36 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:18.047870 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9e98125e-0cdd-41e2-ae4f-3c0424e6ab36 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:18.195955 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-9e98125e-0cdd-41e2-ae4f-3c0424e6ab36 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:18.208343 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-9e98125e-0cdd-41e2-ae4f-3c0424e6ab36 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:18.210444 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-9e98125e-0cdd-41e2-ae4f-3c0424e6ab36 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:18.211771 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-9e98125e-0cdd-41e2-ae4f-3c0424e6ab36 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1740 microversion: 2.20 time: 0.183816 Dec 15 13:35:18.213018 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 382/752] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:35:18 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1740 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:35:19.231018 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-aff4331c-411e-4054-b22d-e011b87c17e6 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:19.231638 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-aff4331c-411e-4054-b22d-e011b87c17e6 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:19.238569 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-aff4331c-411e-4054-b22d-e011b87c17e6 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:19.239175 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-aff4331c-411e-4054-b22d-e011b87c17e6 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:19.240104 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-aff4331c-411e-4054-b22d-e011b87c17e6 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:19.240557 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-aff4331c-411e-4054-b22d-e011b87c17e6 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:19.381205 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-aff4331c-411e-4054-b22d-e011b87c17e6 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:19.390995 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-aff4331c-411e-4054-b22d-e011b87c17e6 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:19.404765 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-aff4331c-411e-4054-b22d-e011b87c17e6 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:19.409960 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-aff4331c-411e-4054-b22d-e011b87c17e6 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1740 microversion: 2.20 time: 0.180120 Dec 15 13:35:19.412475 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 371/753] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:35:19 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1740 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:35:20.431547 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-25953688-8fff-4c24-9ece-0b8ffe4cf7f1 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:20.432196 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-25953688-8fff-4c24-9ece-0b8ffe4cf7f1 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:20.439287 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-25953688-8fff-4c24-9ece-0b8ffe4cf7f1 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:20.439748 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-25953688-8fff-4c24-9ece-0b8ffe4cf7f1 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:20.440623 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-25953688-8fff-4c24-9ece-0b8ffe4cf7f1 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:20.441004 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-25953688-8fff-4c24-9ece-0b8ffe4cf7f1 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:20.597512 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-25953688-8fff-4c24-9ece-0b8ffe4cf7f1 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:20.606676 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-25953688-8fff-4c24-9ece-0b8ffe4cf7f1 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:20.608495 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-25953688-8fff-4c24-9ece-0b8ffe4cf7f1 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:20.609832 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-25953688-8fff-4c24-9ece-0b8ffe4cf7f1 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1740 microversion: 2.20 time: 0.181957 Dec 15 13:35:20.610896 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 383/754] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:35:20 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1740 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:35:21.631995 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-f47d365a-7826-45bf-b297-d713c43e5cdd tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:21.633308 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-f47d365a-7826-45bf-b297-d713c43e5cdd tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:21.640958 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f47d365a-7826-45bf-b297-d713c43e5cdd tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:21.641467 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f47d365a-7826-45bf-b297-d713c43e5cdd tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:21.642698 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f47d365a-7826-45bf-b297-d713c43e5cdd tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:21.643231 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f47d365a-7826-45bf-b297-d713c43e5cdd tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:21.804761 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-f47d365a-7826-45bf-b297-d713c43e5cdd tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:21.820591 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-f47d365a-7826-45bf-b297-d713c43e5cdd tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:21.826014 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-f47d365a-7826-45bf-b297-d713c43e5cdd tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:21.826014 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-f47d365a-7826-45bf-b297-d713c43e5cdd tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1740 microversion: 2.20 time: 0.196759 Dec 15 13:35:21.835166 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 372/755] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:35:21 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1740 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:35:22.842391 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-09e21cfd-53fb-48f5-9121-6baaf5abc28d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:22.843101 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-09e21cfd-53fb-48f5-9121-6baaf5abc28d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:22.849146 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-09e21cfd-53fb-48f5-9121-6baaf5abc28d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:22.849616 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-09e21cfd-53fb-48f5-9121-6baaf5abc28d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:22.850423 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-09e21cfd-53fb-48f5-9121-6baaf5abc28d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:22.850883 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-09e21cfd-53fb-48f5-9121-6baaf5abc28d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:22.990979 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-09e21cfd-53fb-48f5-9121-6baaf5abc28d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:23.000770 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-09e21cfd-53fb-48f5-9121-6baaf5abc28d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:23.002435 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-09e21cfd-53fb-48f5-9121-6baaf5abc28d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:23.003891 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-09e21cfd-53fb-48f5-9121-6baaf5abc28d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1740 microversion: 2.20 time: 0.165148 Dec 15 13:35:23.004461 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 384/756] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:35:22 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1740 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:35:24.022799 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-63b78c9d-f6c9-42f6-8357-6322eab82576 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:24.023574 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-63b78c9d-f6c9-42f6-8357-6322eab82576 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:24.030488 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-63b78c9d-f6c9-42f6-8357-6322eab82576 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:24.030991 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-63b78c9d-f6c9-42f6-8357-6322eab82576 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:24.031819 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-63b78c9d-f6c9-42f6-8357-6322eab82576 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:24.032259 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-63b78c9d-f6c9-42f6-8357-6322eab82576 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:24.175212 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-63b78c9d-f6c9-42f6-8357-6322eab82576 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:24.185984 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-63b78c9d-f6c9-42f6-8357-6322eab82576 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:24.187982 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-63b78c9d-f6c9-42f6-8357-6322eab82576 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:24.191343 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-63b78c9d-f6c9-42f6-8357-6322eab82576 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1740 microversion: 2.20 time: 0.170941 Dec 15 13:35:24.205749 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 373/757] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:35:24 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1740 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:35:25.209540 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-a80a59b5-9f7e-4a1a-b8bd-b1b277b816e9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:25.210218 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-a80a59b5-9f7e-4a1a-b8bd-b1b277b816e9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:25.217841 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a80a59b5-9f7e-4a1a-b8bd-b1b277b816e9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:25.218309 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a80a59b5-9f7e-4a1a-b8bd-b1b277b816e9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:25.219213 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a80a59b5-9f7e-4a1a-b8bd-b1b277b816e9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:25.219658 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a80a59b5-9f7e-4a1a-b8bd-b1b277b816e9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:25.353719 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-a80a59b5-9f7e-4a1a-b8bd-b1b277b816e9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:25.361437 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-a80a59b5-9f7e-4a1a-b8bd-b1b277b816e9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:25.362933 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-a80a59b5-9f7e-4a1a-b8bd-b1b277b816e9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:25.364080 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-a80a59b5-9f7e-4a1a-b8bd-b1b277b816e9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1740 microversion: 2.20 time: 0.158348 Dec 15 13:35:25.364645 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 385/758] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:35:25 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1740 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:35:26.381501 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-4e0f82db-f1db-4c1a-b88c-64233fc1b73c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:26.382144 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-4e0f82db-f1db-4c1a-b88c-64233fc1b73c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:26.389023 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4e0f82db-f1db-4c1a-b88c-64233fc1b73c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:26.389477 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4e0f82db-f1db-4c1a-b88c-64233fc1b73c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:26.390262 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4e0f82db-f1db-4c1a-b88c-64233fc1b73c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:26.390696 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4e0f82db-f1db-4c1a-b88c-64233fc1b73c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:26.530593 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-4e0f82db-f1db-4c1a-b88c-64233fc1b73c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:26.538543 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-4e0f82db-f1db-4c1a-b88c-64233fc1b73c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:26.540131 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-4e0f82db-f1db-4c1a-b88c-64233fc1b73c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:26.541301 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-4e0f82db-f1db-4c1a-b88c-64233fc1b73c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1722 microversion: 2.20 time: 0.163572 Dec 15 13:35:26.541873 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 374/759] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:35:26 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:35:27.559381 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-00d7085c-3f9a-4731-aeb3-aa252c6a6734 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:27.559996 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-00d7085c-3f9a-4731-aeb3-aa252c6a6734 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:27.566502 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-00d7085c-3f9a-4731-aeb3-aa252c6a6734 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:27.566998 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-00d7085c-3f9a-4731-aeb3-aa252c6a6734 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:27.567796 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-00d7085c-3f9a-4731-aeb3-aa252c6a6734 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:27.568236 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-00d7085c-3f9a-4731-aeb3-aa252c6a6734 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:27.703162 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-00d7085c-3f9a-4731-aeb3-aa252c6a6734 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:27.710768 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-00d7085c-3f9a-4731-aeb3-aa252c6a6734 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:27.712289 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-00d7085c-3f9a-4731-aeb3-aa252c6a6734 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:27.714225 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-00d7085c-3f9a-4731-aeb3-aa252c6a6734 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1722 microversion: 2.20 time: 0.158569 Dec 15 13:35:27.714816 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 386/760] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:35:27 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:35:28.731400 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-c0e28d03-cb54-4789-90ba-646f834ece36 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:28.732027 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-c0e28d03-cb54-4789-90ba-646f834ece36 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:28.738217 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c0e28d03-cb54-4789-90ba-646f834ece36 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:28.738665 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c0e28d03-cb54-4789-90ba-646f834ece36 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:28.739476 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c0e28d03-cb54-4789-90ba-646f834ece36 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:28.739912 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c0e28d03-cb54-4789-90ba-646f834ece36 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:28.865777 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-c0e28d03-cb54-4789-90ba-646f834ece36 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:28.873896 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-c0e28d03-cb54-4789-90ba-646f834ece36 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:28.875410 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-c0e28d03-cb54-4789-90ba-646f834ece36 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:28.876544 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-c0e28d03-cb54-4789-90ba-646f834ece36 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1722 microversion: 2.20 time: 0.148908 Dec 15 13:35:28.877106 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 375/761] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:35:28 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:35:29.468577 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-614505db-e564-4ef7-b48c-6c9c94efeb0d req-fb631a8b-cddc-4c13-a8f5-4d8985765925 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00671676-47cb-4266-b9e5-61c7fb120355", "name": "network-vif-unplugged", "status": "completed", "tag": "33030795-e868-427d-8a6a-6d48523668bc"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:35:29.474947 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:35:29.474947 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: warnings.warn(msg) Dec 15 13:35:29.483933 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-614505db-e564-4ef7-b48c-6c9c94efeb0d req-fb631a8b-cddc-4c13-a8f5-4d8985765925 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:29.484442 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-614505db-e564-4ef7-b48c-6c9c94efeb0d req-fb631a8b-cddc-4c13-a8f5-4d8985765925 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:29.496180 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-614505db-e564-4ef7-b48c-6c9c94efeb0d req-fb631a8b-cddc-4c13-a8f5-4d8985765925 service nova] Creating event network-vif-unplugged:33030795-e868-427d-8a6a-6d48523668bc for instance 00671676-47cb-4266-b9e5-61c7fb120355 on hv-cinder-81322 Dec 15 13:35:29.501230 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-614505db-e564-4ef7-b48c-6c9c94efeb0d req-fb631a8b-cddc-4c13-a8f5-4d8985765925 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036249 Dec 15 13:35:29.501827 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 387/762] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:35:29 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:35:29.895092 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-f76ef750-e625-46cf-ae22-6b087c64257f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:29.895652 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-f76ef750-e625-46cf-ae22-6b087c64257f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:29.902359 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f76ef750-e625-46cf-ae22-6b087c64257f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:29.902805 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f76ef750-e625-46cf-ae22-6b087c64257f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:29.903600 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f76ef750-e625-46cf-ae22-6b087c64257f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:29.904031 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f76ef750-e625-46cf-ae22-6b087c64257f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:30.033107 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-f76ef750-e625-46cf-ae22-6b087c64257f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:30.040637 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-f76ef750-e625-46cf-ae22-6b087c64257f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:30.042118 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-f76ef750-e625-46cf-ae22-6b087c64257f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:30.043292 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-f76ef750-e625-46cf-ae22-6b087c64257f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1722 microversion: 2.20 time: 0.151995 Dec 15 13:35:30.043857 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 376/763] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:35:29 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:35:31.061547 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-22ddd632-afc0-4fb1-9713-ce067b6b3c9a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:31.062244 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-22ddd632-afc0-4fb1-9713-ce067b6b3c9a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:31.068664 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-22ddd632-afc0-4fb1-9713-ce067b6b3c9a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:31.069110 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-22ddd632-afc0-4fb1-9713-ce067b6b3c9a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:31.070140 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-22ddd632-afc0-4fb1-9713-ce067b6b3c9a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:31.070573 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-22ddd632-afc0-4fb1-9713-ce067b6b3c9a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:31.195978 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-22ddd632-afc0-4fb1-9713-ce067b6b3c9a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:31.203514 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-22ddd632-afc0-4fb1-9713-ce067b6b3c9a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:31.205027 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-22ddd632-afc0-4fb1-9713-ce067b6b3c9a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:31.206167 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-22ddd632-afc0-4fb1-9713-ce067b6b3c9a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1722 microversion: 2.20 time: 0.148655 Dec 15 13:35:31.206730 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 388/764] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:35:31 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:35:32.224875 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-9458d141-6270-4f2a-94bc-4695dd69f543 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:32.225488 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-9458d141-6270-4f2a-94bc-4695dd69f543 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:32.232354 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9458d141-6270-4f2a-94bc-4695dd69f543 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:32.232799 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9458d141-6270-4f2a-94bc-4695dd69f543 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:32.233586 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9458d141-6270-4f2a-94bc-4695dd69f543 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:32.234024 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9458d141-6270-4f2a-94bc-4695dd69f543 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:32.361241 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-9458d141-6270-4f2a-94bc-4695dd69f543 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:32.370059 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-9458d141-6270-4f2a-94bc-4695dd69f543 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:32.371225 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-9458d141-6270-4f2a-94bc-4695dd69f543 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:32.372426 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-9458d141-6270-4f2a-94bc-4695dd69f543 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1722 microversion: 2.20 time: 0.151242 Dec 15 13:35:32.373001 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 377/765] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:35:32 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:35:33.390890 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-5721c288-c663-46f3-a283-85f19c9c273d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:33.391592 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-5721c288-c663-46f3-a283-85f19c9c273d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:33.397796 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5721c288-c663-46f3-a283-85f19c9c273d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:33.398245 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5721c288-c663-46f3-a283-85f19c9c273d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:33.399056 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5721c288-c663-46f3-a283-85f19c9c273d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:33.399495 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5721c288-c663-46f3-a283-85f19c9c273d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:33.536235 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-5721c288-c663-46f3-a283-85f19c9c273d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:33.544904 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-5721c288-c663-46f3-a283-85f19c9c273d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:33.546484 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-5721c288-c663-46f3-a283-85f19c9c273d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:33.547664 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-5721c288-c663-46f3-a283-85f19c9c273d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1722 microversion: 2.20 time: 0.160530 Dec 15 13:35:33.548230 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 389/766] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:35:33 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:35:34.569950 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-cb385c21-29aa-46e5-b832-d1238ebc8ea2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:34.570334 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-cb385c21-29aa-46e5-b832-d1238ebc8ea2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:34.577232 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cb385c21-29aa-46e5-b832-d1238ebc8ea2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:34.577764 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cb385c21-29aa-46e5-b832-d1238ebc8ea2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:34.578639 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cb385c21-29aa-46e5-b832-d1238ebc8ea2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:34.579063 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cb385c21-29aa-46e5-b832-d1238ebc8ea2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:34.741129 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-cb385c21-29aa-46e5-b832-d1238ebc8ea2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:34.749228 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-cb385c21-29aa-46e5-b832-d1238ebc8ea2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:34.750957 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-cb385c21-29aa-46e5-b832-d1238ebc8ea2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:34.752684 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-cb385c21-29aa-46e5-b832-d1238ebc8ea2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1665 microversion: 2.20 time: 0.187022 Dec 15 13:35:34.753270 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 378/767] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:35:34 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1665 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:35:34.770524 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-791a3c42-366b-4ca1-a0ce-d56957e90ce5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "809346d8-d3f4-4172-88b7-fdc8e000c19f"}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:35:34.771623 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-791a3c42-366b-4ca1-a0ce-d56957e90ce5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:34.778933 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-791a3c42-366b-4ca1-a0ce-d56957e90ce5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:34.779399 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-791a3c42-366b-4ca1-a0ce-d56957e90ce5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:34.780201 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-791a3c42-366b-4ca1-a0ce-d56957e90ce5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:34.780649 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-791a3c42-366b-4ca1-a0ce-d56957e90ce5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:35.072256 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-791a3c42-366b-4ca1-a0ce-d56957e90ce5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.305396 Dec 15 13:35:35.073523 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 390/768] 10.222.0.60 () {62 vars in 1363 bytes} [Wed Dec 15 13:35:34 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/os-volume_attachments => generated 188 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:35:35.178743 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-0359fe64-a7a2-4b86-99bf-4e1a04d0ce11 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:35:35.179355 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-0359fe64-a7a2-4b86-99bf-4e1a04d0ce11 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:35.185653 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0359fe64-a7a2-4b86-99bf-4e1a04d0ce11 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:35.186105 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0359fe64-a7a2-4b86-99bf-4e1a04d0ce11 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:35.186910 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0359fe64-a7a2-4b86-99bf-4e1a04d0ce11 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:35.187350 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0359fe64-a7a2-4b86-99bf-4e1a04d0ce11 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:35.274559 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-0359fe64-a7a2-4b86-99bf-4e1a04d0ce11 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action" status: 202 len: 0 microversion: 2.20 time: 0.099422 Dec 15 13:35:35.275210 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 379/769] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:35:35 2021] POST /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:35:35.283180 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-189d797e-77b1-454e-8401-47fedca05294 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:35.283920 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-189d797e-77b1-454e-8401-47fedca05294 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:35.290631 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-189d797e-77b1-454e-8401-47fedca05294 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:35.291700 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-189d797e-77b1-454e-8401-47fedca05294 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:35.292585 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-189d797e-77b1-454e-8401-47fedca05294 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:35.293240 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-189d797e-77b1-454e-8401-47fedca05294 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:35.444220 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-189d797e-77b1-454e-8401-47fedca05294 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:35.457465 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-189d797e-77b1-454e-8401-47fedca05294 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:35.459141 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-189d797e-77b1-454e-8401-47fedca05294 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:35.460313 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-189d797e-77b1-454e-8401-47fedca05294 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1751 microversion: 2.20 time: 0.180895 Dec 15 13:35:35.461169 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 391/770] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:35:35 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1751 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:35:36.480527 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-5cec4017-4078-42da-80ac-fe29f78099c5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:36.481136 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-5cec4017-4078-42da-80ac-fe29f78099c5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:36.488044 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5cec4017-4078-42da-80ac-fe29f78099c5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:36.488497 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5cec4017-4078-42da-80ac-fe29f78099c5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:36.489279 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5cec4017-4078-42da-80ac-fe29f78099c5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:36.489720 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5cec4017-4078-42da-80ac-fe29f78099c5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:36.618487 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-5cec4017-4078-42da-80ac-fe29f78099c5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:36.627229 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-5cec4017-4078-42da-80ac-fe29f78099c5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:36.628814 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-5cec4017-4078-42da-80ac-fe29f78099c5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:36.630092 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-5cec4017-4078-42da-80ac-fe29f78099c5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1753 microversion: 2.20 time: 0.153731 Dec 15 13:35:36.630952 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 380/771] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:35:36 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:35:37.650657 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-0171854b-7821-49e0-96f0-da2d026a0396 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:37.659160 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-0171854b-7821-49e0-96f0-da2d026a0396 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:37.673743 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0171854b-7821-49e0-96f0-da2d026a0396 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:37.674212 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0171854b-7821-49e0-96f0-da2d026a0396 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:37.675073 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0171854b-7821-49e0-96f0-da2d026a0396 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:37.675547 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0171854b-7821-49e0-96f0-da2d026a0396 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:37.896567 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-0171854b-7821-49e0-96f0-da2d026a0396 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:37.906753 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-0171854b-7821-49e0-96f0-da2d026a0396 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:37.908704 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-0171854b-7821-49e0-96f0-da2d026a0396 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:37.909884 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-0171854b-7821-49e0-96f0-da2d026a0396 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1809 microversion: 2.20 time: 0.264036 Dec 15 13:35:37.910785 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 392/772] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:35:37 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1809 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:35:38.928168 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-e8085a12-dc00-43e7-b224-640b9ff19dea tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:38.929471 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-e8085a12-dc00-43e7-b224-640b9ff19dea tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:38.936764 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e8085a12-dc00-43e7-b224-640b9ff19dea tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:38.937222 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e8085a12-dc00-43e7-b224-640b9ff19dea tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:38.938033 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e8085a12-dc00-43e7-b224-640b9ff19dea tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:38.938480 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e8085a12-dc00-43e7-b224-640b9ff19dea tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:39.108410 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-e8085a12-dc00-43e7-b224-640b9ff19dea tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:39.117209 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-e8085a12-dc00-43e7-b224-640b9ff19dea tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:39.124546 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-e8085a12-dc00-43e7-b224-640b9ff19dea tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:39.125891 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-e8085a12-dc00-43e7-b224-640b9ff19dea tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1809 microversion: 2.20 time: 0.201571 Dec 15 13:35:39.126573 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 381/773] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:35:38 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1809 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:35:40.144270 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-cd40aec6-2af6-4bdf-ae84-40bee3f86884 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:40.144986 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-cd40aec6-2af6-4bdf-ae84-40bee3f86884 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:40.151155 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-cd40aec6-2af6-4bdf-ae84-40bee3f86884 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:40.151637 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-cd40aec6-2af6-4bdf-ae84-40bee3f86884 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:40.152428 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-cd40aec6-2af6-4bdf-ae84-40bee3f86884 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:40.152877 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-cd40aec6-2af6-4bdf-ae84-40bee3f86884 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:40.299834 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-cd40aec6-2af6-4bdf-ae84-40bee3f86884 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:40.312157 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-cd40aec6-2af6-4bdf-ae84-40bee3f86884 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:40.314415 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-cd40aec6-2af6-4bdf-ae84-40bee3f86884 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:40.315808 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-cd40aec6-2af6-4bdf-ae84-40bee3f86884 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1809 microversion: 2.20 time: 0.175217 Dec 15 13:35:40.320321 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 393/774] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:35:40 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:35:41.339267 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-ed8bb850-2449-45ef-8a87-f357bd22f6cf tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:41.340738 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-ed8bb850-2449-45ef-8a87-f357bd22f6cf tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:41.348872 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ed8bb850-2449-45ef-8a87-f357bd22f6cf tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:41.349555 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ed8bb850-2449-45ef-8a87-f357bd22f6cf tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:41.350363 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ed8bb850-2449-45ef-8a87-f357bd22f6cf tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:41.350835 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ed8bb850-2449-45ef-8a87-f357bd22f6cf tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:41.534552 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-ed8bb850-2449-45ef-8a87-f357bd22f6cf tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:41.548211 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-ed8bb850-2449-45ef-8a87-f357bd22f6cf tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:41.550040 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-ed8bb850-2449-45ef-8a87-f357bd22f6cf tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:41.551497 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-ed8bb850-2449-45ef-8a87-f357bd22f6cf tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1809 microversion: 2.20 time: 0.216038 Dec 15 13:35:41.552100 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 382/775] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:35:41 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1809 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:35:42.570028 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-e92f8168-79d9-443a-a3b4-c9345f043e2d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:42.570634 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-e92f8168-79d9-443a-a3b4-c9345f043e2d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:42.577514 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e92f8168-79d9-443a-a3b4-c9345f043e2d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:42.577960 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e92f8168-79d9-443a-a3b4-c9345f043e2d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:42.578738 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e92f8168-79d9-443a-a3b4-c9345f043e2d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:42.579197 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e92f8168-79d9-443a-a3b4-c9345f043e2d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:42.717569 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-e92f8168-79d9-443a-a3b4-c9345f043e2d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:42.728151 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-e92f8168-79d9-443a-a3b4-c9345f043e2d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:42.731374 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-e92f8168-79d9-443a-a3b4-c9345f043e2d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:42.732550 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-e92f8168-79d9-443a-a3b4-c9345f043e2d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1809 microversion: 2.20 time: 0.166391 Dec 15 13:35:42.733137 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 394/776] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:35:42 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:35:43.751114 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-76a252b8-8a9d-4c69-8961-4dc006e15e7c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:43.751726 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-76a252b8-8a9d-4c69-8961-4dc006e15e7c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:43.758123 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-76a252b8-8a9d-4c69-8961-4dc006e15e7c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:43.758571 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-76a252b8-8a9d-4c69-8961-4dc006e15e7c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:43.759378 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-76a252b8-8a9d-4c69-8961-4dc006e15e7c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:43.759814 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-76a252b8-8a9d-4c69-8961-4dc006e15e7c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:43.900097 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-76a252b8-8a9d-4c69-8961-4dc006e15e7c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:43.909336 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-76a252b8-8a9d-4c69-8961-4dc006e15e7c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:43.911207 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-76a252b8-8a9d-4c69-8961-4dc006e15e7c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:43.912636 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-76a252b8-8a9d-4c69-8961-4dc006e15e7c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1809 microversion: 2.20 time: 0.165300 Dec 15 13:35:43.923015 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 383/777] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:35:43 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:35:44.931015 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-6dc21254-bc61-42dd-81d2-c47e2961cce0 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:44.931706 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-6dc21254-bc61-42dd-81d2-c47e2961cce0 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:44.937946 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6dc21254-bc61-42dd-81d2-c47e2961cce0 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:44.938633 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6dc21254-bc61-42dd-81d2-c47e2961cce0 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:44.939457 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6dc21254-bc61-42dd-81d2-c47e2961cce0 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:44.940054 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6dc21254-bc61-42dd-81d2-c47e2961cce0 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:45.097986 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-6dc21254-bc61-42dd-81d2-c47e2961cce0 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:45.107007 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-6dc21254-bc61-42dd-81d2-c47e2961cce0 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:45.108683 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-6dc21254-bc61-42dd-81d2-c47e2961cce0 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:45.110019 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-6dc21254-bc61-42dd-81d2-c47e2961cce0 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1809 microversion: 2.20 time: 0.182867 Dec 15 13:35:45.110584 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 395/778] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:35:44 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1809 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:35:46.129396 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-2e63d18c-20d9-4af4-8c78-15b7e9297793 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:46.130097 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-2e63d18c-20d9-4af4-8c78-15b7e9297793 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:46.136381 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2e63d18c-20d9-4af4-8c78-15b7e9297793 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:46.136838 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2e63d18c-20d9-4af4-8c78-15b7e9297793 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:46.137881 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2e63d18c-20d9-4af4-8c78-15b7e9297793 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:46.138409 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2e63d18c-20d9-4af4-8c78-15b7e9297793 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:46.298887 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-2e63d18c-20d9-4af4-8c78-15b7e9297793 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:46.307930 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-2e63d18c-20d9-4af4-8c78-15b7e9297793 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:46.309612 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-2e63d18c-20d9-4af4-8c78-15b7e9297793 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:46.311076 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-2e63d18c-20d9-4af4-8c78-15b7e9297793 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1809 microversion: 2.20 time: 0.185713 Dec 15 13:35:46.311865 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 384/779] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:35:46 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1809 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:35:47.331205 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-cf5cd2a0-d3f3-4aa8-9942-77e85b6a5ba9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:47.331828 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-cf5cd2a0-d3f3-4aa8-9942-77e85b6a5ba9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:47.337775 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-cf5cd2a0-d3f3-4aa8-9942-77e85b6a5ba9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:47.338233 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-cf5cd2a0-d3f3-4aa8-9942-77e85b6a5ba9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:47.339143 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-cf5cd2a0-d3f3-4aa8-9942-77e85b6a5ba9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:47.339583 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-cf5cd2a0-d3f3-4aa8-9942-77e85b6a5ba9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:47.483217 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-cf5cd2a0-d3f3-4aa8-9942-77e85b6a5ba9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:47.497193 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-cf5cd2a0-d3f3-4aa8-9942-77e85b6a5ba9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:47.499139 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-cf5cd2a0-d3f3-4aa8-9942-77e85b6a5ba9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:47.500482 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-cf5cd2a0-d3f3-4aa8-9942-77e85b6a5ba9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1809 microversion: 2.20 time: 0.173060 Dec 15 13:35:47.501150 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 396/780] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:35:47 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:35:48.520276 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-b2bd9f66-ef55-4ae5-b7e1-f8cc8b3c763e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:48.520997 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-b2bd9f66-ef55-4ae5-b7e1-f8cc8b3c763e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:48.527401 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b2bd9f66-ef55-4ae5-b7e1-f8cc8b3c763e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:48.528151 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b2bd9f66-ef55-4ae5-b7e1-f8cc8b3c763e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:48.528957 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b2bd9f66-ef55-4ae5-b7e1-f8cc8b3c763e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:48.529431 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b2bd9f66-ef55-4ae5-b7e1-f8cc8b3c763e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:48.706261 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-b2bd9f66-ef55-4ae5-b7e1-f8cc8b3c763e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:48.730100 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-b2bd9f66-ef55-4ae5-b7e1-f8cc8b3c763e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:48.736003 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-b2bd9f66-ef55-4ae5-b7e1-f8cc8b3c763e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:48.737693 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-b2bd9f66-ef55-4ae5-b7e1-f8cc8b3c763e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1809 microversion: 2.20 time: 0.221804 Dec 15 13:35:48.738649 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 385/781] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:35:48 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1809 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:35:49.759387 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-5c07ac64-e119-4d4e-93c0-c8432d2ccd4d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:49.760005 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-5c07ac64-e119-4d4e-93c0-c8432d2ccd4d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:49.771493 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5c07ac64-e119-4d4e-93c0-c8432d2ccd4d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:49.771975 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5c07ac64-e119-4d4e-93c0-c8432d2ccd4d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:49.773102 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5c07ac64-e119-4d4e-93c0-c8432d2ccd4d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:49.773546 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5c07ac64-e119-4d4e-93c0-c8432d2ccd4d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:50.034840 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-5c07ac64-e119-4d4e-93c0-c8432d2ccd4d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:50.048725 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-5c07ac64-e119-4d4e-93c0-c8432d2ccd4d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:50.050619 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-5c07ac64-e119-4d4e-93c0-c8432d2ccd4d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:50.051924 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-5c07ac64-e119-4d4e-93c0-c8432d2ccd4d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1809 microversion: 2.20 time: 0.296866 Dec 15 13:35:50.052542 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 397/782] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:35:49 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1809 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:35:51.074746 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-a077ef7a-ca26-48ba-812f-151621c99899 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:51.075556 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-a077ef7a-ca26-48ba-812f-151621c99899 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:51.083347 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a077ef7a-ca26-48ba-812f-151621c99899 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:51.083815 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a077ef7a-ca26-48ba-812f-151621c99899 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:51.084632 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a077ef7a-ca26-48ba-812f-151621c99899 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:51.085107 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a077ef7a-ca26-48ba-812f-151621c99899 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:51.246452 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-a077ef7a-ca26-48ba-812f-151621c99899 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:51.257274 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-a077ef7a-ca26-48ba-812f-151621c99899 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:51.258664 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-a077ef7a-ca26-48ba-812f-151621c99899 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:51.260055 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-a077ef7a-ca26-48ba-812f-151621c99899 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1809 microversion: 2.20 time: 0.194256 Dec 15 13:35:51.260642 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 386/783] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:35:51 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1809 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:35:52.278543 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-9f8e96fb-d4e0-4cd3-ab82-caab47ca870e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:52.279281 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-9f8e96fb-d4e0-4cd3-ab82-caab47ca870e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:52.285990 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9f8e96fb-d4e0-4cd3-ab82-caab47ca870e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:52.286441 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9f8e96fb-d4e0-4cd3-ab82-caab47ca870e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:52.287267 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9f8e96fb-d4e0-4cd3-ab82-caab47ca870e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:52.287699 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9f8e96fb-d4e0-4cd3-ab82-caab47ca870e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:52.438411 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-3c24c48e-fb7b-4c64-85fe-bbf97bf37ada tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:35:52.440318 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-3c24c48e-fb7b-4c64-85fe-bbf97bf37ada tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:52.447627 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-9f8e96fb-d4e0-4cd3-ab82-caab47ca870e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:52.457707 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3c24c48e-fb7b-4c64-85fe-bbf97bf37ada tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:52.458503 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3c24c48e-fb7b-4c64-85fe-bbf97bf37ada tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:52.459367 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3c24c48e-fb7b-4c64-85fe-bbf97bf37ada tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:52.459841 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3c24c48e-fb7b-4c64-85fe-bbf97bf37ada tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:52.474203 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-9f8e96fb-d4e0-4cd3-ab82-caab47ca870e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:52.476048 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-9f8e96fb-d4e0-4cd3-ab82-caab47ca870e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:52.478214 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-9f8e96fb-d4e0-4cd3-ab82-caab47ca870e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1809 microversion: 2.20 time: 0.202880 Dec 15 13:35:52.479156 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 398/784] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:35:52 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1809 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:35:52.545298 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-3c24c48e-fb7b-4c64-85fe-bbf97bf37ada tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "POST /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb/action" status: 202 len: 0 microversion: 2.1 time: 0.112061 Dec 15 13:35:52.545958 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 387/785] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:35:52 2021] POST /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:35:52.553664 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-406e6a94-3184-4123-853f-f888d087d533 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:52.554278 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-406e6a94-3184-4123-853f-f888d087d533 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:52.560752 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-406e6a94-3184-4123-853f-f888d087d533 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:52.561204 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-406e6a94-3184-4123-853f-f888d087d533 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:52.561989 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-406e6a94-3184-4123-853f-f888d087d533 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:52.562444 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-406e6a94-3184-4123-853f-f888d087d533 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:52.709764 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-406e6a94-3184-4123-853f-f888d087d533 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed1331bcb0e4fe4a53379d1d72f650a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38faa56e5864d3aba51e1e8351e3a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:52.718552 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-406e6a94-3184-4123-853f-f888d087d533 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb" status: 200 len: 1750 microversion: 2.1 time: 0.168360 Dec 15 13:35:52.719530 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 399/786] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:35:52 2021] GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb => generated 1750 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:35:53.498380 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-3fcef0a0-df1a-4386-86ba-9c85d753a919 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:53.499111 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-3fcef0a0-df1a-4386-86ba-9c85d753a919 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:53.505609 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3fcef0a0-df1a-4386-86ba-9c85d753a919 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:53.506061 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3fcef0a0-df1a-4386-86ba-9c85d753a919 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:53.506840 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3fcef0a0-df1a-4386-86ba-9c85d753a919 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:53.507305 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3fcef0a0-df1a-4386-86ba-9c85d753a919 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:53.644715 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-3fcef0a0-df1a-4386-86ba-9c85d753a919 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:53.652764 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-3fcef0a0-df1a-4386-86ba-9c85d753a919 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:53.654427 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-3fcef0a0-df1a-4386-86ba-9c85d753a919 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:53.655625 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-3fcef0a0-df1a-4386-86ba-9c85d753a919 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1809 microversion: 2.20 time: 0.161816 Dec 15 13:35:53.656185 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 388/787] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:35:53 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:35:53.736872 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-0eaa00b7-c6fe-43bb-965a-1afac5d04496 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:53.737488 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-0eaa00b7-c6fe-43bb-965a-1afac5d04496 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:53.743788 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0eaa00b7-c6fe-43bb-965a-1afac5d04496 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:53.744247 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0eaa00b7-c6fe-43bb-965a-1afac5d04496 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:53.745035 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0eaa00b7-c6fe-43bb-965a-1afac5d04496 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:53.745479 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0eaa00b7-c6fe-43bb-965a-1afac5d04496 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:53.888627 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-0eaa00b7-c6fe-43bb-965a-1afac5d04496 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed1331bcb0e4fe4a53379d1d72f650a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38faa56e5864d3aba51e1e8351e3a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:53.896271 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-0eaa00b7-c6fe-43bb-965a-1afac5d04496 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb" status: 200 len: 1750 microversion: 2.1 time: 0.163027 Dec 15 13:35:53.896849 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 400/788] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:35:53 2021] GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb => generated 1750 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:35:54.387871 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:35:54.388092 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: Wed Dec 15 13:35:54 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 13:35:54.674810 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-8889b5fc-3e83-465c-a4fe-e8952943b9c7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:54.675357 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-8889b5fc-3e83-465c-a4fe-e8952943b9c7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:54.681786 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8889b5fc-3e83-465c-a4fe-e8952943b9c7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:54.682239 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8889b5fc-3e83-465c-a4fe-e8952943b9c7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:54.683064 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8889b5fc-3e83-465c-a4fe-e8952943b9c7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:54.683505 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8889b5fc-3e83-465c-a4fe-e8952943b9c7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:54.819150 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-8889b5fc-3e83-465c-a4fe-e8952943b9c7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:54.828066 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-8889b5fc-3e83-465c-a4fe-e8952943b9c7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:54.829563 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-8889b5fc-3e83-465c-a4fe-e8952943b9c7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:54.830716 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-8889b5fc-3e83-465c-a4fe-e8952943b9c7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1809 microversion: 2.20 time: 0.161225 Dec 15 13:35:54.831319 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 389/789] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:35:54 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:35:54.913239 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-50cdc808-a500-4ef4-9770-e866bba7152b tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:54.913817 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-50cdc808-a500-4ef4-9770-e866bba7152b tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:54.920077 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-50cdc808-a500-4ef4-9770-e866bba7152b tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:54.920533 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-50cdc808-a500-4ef4-9770-e866bba7152b tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:54.921342 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-50cdc808-a500-4ef4-9770-e866bba7152b tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:54.921787 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-50cdc808-a500-4ef4-9770-e866bba7152b tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:55.070915 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-50cdc808-a500-4ef4-9770-e866bba7152b tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed1331bcb0e4fe4a53379d1d72f650a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38faa56e5864d3aba51e1e8351e3a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:55.079222 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-50cdc808-a500-4ef4-9770-e866bba7152b tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb" status: 200 len: 1750 microversion: 2.1 time: 0.169647 Dec 15 13:35:55.079788 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 401/790] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:35:54 2021] GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb => generated 1750 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:35:55.849259 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-6bcd9216-acc8-4337-ad1b-07464e247b23 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:55.849864 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-6bcd9216-acc8-4337-ad1b-07464e247b23 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:55.857230 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6bcd9216-acc8-4337-ad1b-07464e247b23 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:55.857682 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6bcd9216-acc8-4337-ad1b-07464e247b23 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:55.858461 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6bcd9216-acc8-4337-ad1b-07464e247b23 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:55.858922 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6bcd9216-acc8-4337-ad1b-07464e247b23 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:55.994872 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-6bcd9216-acc8-4337-ad1b-07464e247b23 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:56.005207 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-6bcd9216-acc8-4337-ad1b-07464e247b23 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:56.006789 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-6bcd9216-acc8-4337-ad1b-07464e247b23 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:56.007989 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-6bcd9216-acc8-4337-ad1b-07464e247b23 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1809 microversion: 2.20 time: 0.162453 Dec 15 13:35:56.008553 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 390/791] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:35:55 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:35:56.096711 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-156319c2-6e4d-4119-a2a8-352b7eeda248 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:56.097321 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-156319c2-6e4d-4119-a2a8-352b7eeda248 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:56.103401 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-156319c2-6e4d-4119-a2a8-352b7eeda248 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:56.103851 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-156319c2-6e4d-4119-a2a8-352b7eeda248 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:56.104628 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-156319c2-6e4d-4119-a2a8-352b7eeda248 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:56.105061 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-156319c2-6e4d-4119-a2a8-352b7eeda248 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:56.269181 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-156319c2-6e4d-4119-a2a8-352b7eeda248 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed1331bcb0e4fe4a53379d1d72f650a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38faa56e5864d3aba51e1e8351e3a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:56.279900 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-156319c2-6e4d-4119-a2a8-352b7eeda248 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb" status: 200 len: 1750 microversion: 2.1 time: 0.186869 Dec 15 13:35:56.290020 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 402/792] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:35:56 2021] GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb => generated 1750 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:35:57.025403 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-0e96efab-ff3b-4224-847c-94115c745688 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:57.026023 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-0e96efab-ff3b-4224-847c-94115c745688 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:57.032385 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0e96efab-ff3b-4224-847c-94115c745688 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:57.032841 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0e96efab-ff3b-4224-847c-94115c745688 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:57.033633 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0e96efab-ff3b-4224-847c-94115c745688 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:57.034078 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0e96efab-ff3b-4224-847c-94115c745688 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:57.164661 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-0e96efab-ff3b-4224-847c-94115c745688 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:57.173434 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-0e96efab-ff3b-4224-847c-94115c745688 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:57.174950 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-0e96efab-ff3b-4224-847c-94115c745688 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:57.176167 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-0e96efab-ff3b-4224-847c-94115c745688 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1809 microversion: 2.20 time: 0.154534 Dec 15 13:35:57.176722 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 391/793] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:35:57 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:35:57.300080 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-7bc1d19d-f122-4822-a85e-adc2c01067d2 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:57.300080 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-7bc1d19d-f122-4822-a85e-adc2c01067d2 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:57.306674 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7bc1d19d-f122-4822-a85e-adc2c01067d2 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:57.307156 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7bc1d19d-f122-4822-a85e-adc2c01067d2 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:57.307955 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7bc1d19d-f122-4822-a85e-adc2c01067d2 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:57.308394 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7bc1d19d-f122-4822-a85e-adc2c01067d2 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:57.460979 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-7bc1d19d-f122-4822-a85e-adc2c01067d2 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed1331bcb0e4fe4a53379d1d72f650a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38faa56e5864d3aba51e1e8351e3a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:57.469536 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-7bc1d19d-f122-4822-a85e-adc2c01067d2 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb" status: 200 len: 1750 microversion: 2.1 time: 0.175665 Dec 15 13:35:57.470225 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 403/794] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:35:57 2021] GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb => generated 1750 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:35:58.195256 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-1d20394c-92aa-4855-b2d4-0d5f3bb1c828 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:58.195851 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-1d20394c-92aa-4855-b2d4-0d5f3bb1c828 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:58.202830 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1d20394c-92aa-4855-b2d4-0d5f3bb1c828 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:58.203317 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1d20394c-92aa-4855-b2d4-0d5f3bb1c828 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:58.204115 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1d20394c-92aa-4855-b2d4-0d5f3bb1c828 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:58.204557 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1d20394c-92aa-4855-b2d4-0d5f3bb1c828 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:58.486968 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-c6b70b24-6c5f-454a-9ca9-2cfc82beb0a2 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:58.488259 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-c6b70b24-6c5f-454a-9ca9-2cfc82beb0a2 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:58.494493 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c6b70b24-6c5f-454a-9ca9-2cfc82beb0a2 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:58.495250 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c6b70b24-6c5f-454a-9ca9-2cfc82beb0a2 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:58.496060 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c6b70b24-6c5f-454a-9ca9-2cfc82beb0a2 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:58.496540 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c6b70b24-6c5f-454a-9ca9-2cfc82beb0a2 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:58.862389 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-1d20394c-92aa-4855-b2d4-0d5f3bb1c828 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:58.876036 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-1d20394c-92aa-4855-b2d4-0d5f3bb1c828 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:58.879611 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-1d20394c-92aa-4855-b2d4-0d5f3bb1c828 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:58.880916 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-1d20394c-92aa-4855-b2d4-0d5f3bb1c828 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1809 microversion: 2.20 time: 0.690006 Dec 15 13:35:58.881567 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 392/795] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:35:58 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1809 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:35:59.064149 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-c6b70b24-6c5f-454a-9ca9-2cfc82beb0a2 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed1331bcb0e4fe4a53379d1d72f650a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38faa56e5864d3aba51e1e8351e3a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:35:59.077744 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-c6b70b24-6c5f-454a-9ca9-2cfc82beb0a2 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb" status: 200 len: 1750 microversion: 2.1 time: 0.594393 Dec 15 13:35:59.078366 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 404/796] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:35:58 2021] GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb => generated 1750 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:35:59.900133 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-f490f7db-31f5-456f-bc44-5d77d9976def tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:35:59.901381 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-f490f7db-31f5-456f-bc44-5d77d9976def tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:35:59.909896 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f490f7db-31f5-456f-bc44-5d77d9976def tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:59.910636 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f490f7db-31f5-456f-bc44-5d77d9976def tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:59.911486 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f490f7db-31f5-456f-bc44-5d77d9976def tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:59.912086 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f490f7db-31f5-456f-bc44-5d77d9976def tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:00.069210 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-f490f7db-31f5-456f-bc44-5d77d9976def tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:00.079162 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-f490f7db-31f5-456f-bc44-5d77d9976def tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:00.080703 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-f490f7db-31f5-456f-bc44-5d77d9976def tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:00.082047 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-f490f7db-31f5-456f-bc44-5d77d9976def tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1809 microversion: 2.20 time: 0.186517 Dec 15 13:36:00.082613 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 393/797] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:35:59 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1809 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:36:00.098382 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ea2e27f5-5b4e-4136-883d-aba9ae6fc4c8 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:00.099810 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ea2e27f5-5b4e-4136-883d-aba9ae6fc4c8 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:00.106729 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ea2e27f5-5b4e-4136-883d-aba9ae6fc4c8 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:00.107329 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ea2e27f5-5b4e-4136-883d-aba9ae6fc4c8 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:00.109016 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ea2e27f5-5b4e-4136-883d-aba9ae6fc4c8 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:00.109693 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ea2e27f5-5b4e-4136-883d-aba9ae6fc4c8 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:00.269062 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-ea2e27f5-5b4e-4136-883d-aba9ae6fc4c8 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed1331bcb0e4fe4a53379d1d72f650a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38faa56e5864d3aba51e1e8351e3a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:00.278921 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ea2e27f5-5b4e-4136-883d-aba9ae6fc4c8 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb" status: 200 len: 1750 microversion: 2.1 time: 0.184303 Dec 15 13:36:00.279619 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 405/798] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:36:00 2021] GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb => generated 1750 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:36:01.101862 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-1a8045ac-0fd0-4dc4-8041-2202595c80d5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:01.103363 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-1a8045ac-0fd0-4dc4-8041-2202595c80d5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:01.110425 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1a8045ac-0fd0-4dc4-8041-2202595c80d5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:01.111281 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1a8045ac-0fd0-4dc4-8041-2202595c80d5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:01.112087 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1a8045ac-0fd0-4dc4-8041-2202595c80d5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:01.112527 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1a8045ac-0fd0-4dc4-8041-2202595c80d5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:01.261131 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-1a8045ac-0fd0-4dc4-8041-2202595c80d5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:01.273291 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-1a8045ac-0fd0-4dc4-8041-2202595c80d5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:01.275245 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-1a8045ac-0fd0-4dc4-8041-2202595c80d5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:01.277237 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-1a8045ac-0fd0-4dc4-8041-2202595c80d5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1809 microversion: 2.20 time: 0.179296 Dec 15 13:36:01.278027 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 394/799] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:36:01 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:36:01.299704 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ab1fc8b0-f976-451d-b4fe-95a7cfd7f738 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:01.300990 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ab1fc8b0-f976-451d-b4fe-95a7cfd7f738 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:01.308583 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ab1fc8b0-f976-451d-b4fe-95a7cfd7f738 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:01.309919 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ab1fc8b0-f976-451d-b4fe-95a7cfd7f738 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:01.311120 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ab1fc8b0-f976-451d-b4fe-95a7cfd7f738 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:01.312565 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ab1fc8b0-f976-451d-b4fe-95a7cfd7f738 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:01.514489 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-ab1fc8b0-f976-451d-b4fe-95a7cfd7f738 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed1331bcb0e4fe4a53379d1d72f650a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38faa56e5864d3aba51e1e8351e3a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:01.526276 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ab1fc8b0-f976-451d-b4fe-95a7cfd7f738 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb" status: 200 len: 1750 microversion: 2.1 time: 0.229511 Dec 15 13:36:01.531984 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 406/800] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:36:01 2021] GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb => generated 1750 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:36:02.296420 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-99d79511-ffa8-4ab5-b268-24a79b1b8355 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:02.297014 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-99d79511-ffa8-4ab5-b268-24a79b1b8355 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:02.303525 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-99d79511-ffa8-4ab5-b268-24a79b1b8355 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:02.304116 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-99d79511-ffa8-4ab5-b268-24a79b1b8355 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:02.305278 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-99d79511-ffa8-4ab5-b268-24a79b1b8355 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:02.305901 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-99d79511-ffa8-4ab5-b268-24a79b1b8355 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:02.471442 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-99d79511-ffa8-4ab5-b268-24a79b1b8355 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:02.480418 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-99d79511-ffa8-4ab5-b268-24a79b1b8355 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:02.482524 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-99d79511-ffa8-4ab5-b268-24a79b1b8355 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:02.484982 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-99d79511-ffa8-4ab5-b268-24a79b1b8355 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1809 microversion: 2.20 time: 0.193266 Dec 15 13:36:02.486096 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 395/801] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:36:02 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1809 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:36:02.550336 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-c3dc3fb3-0efd-4ca0-a075-fb77e5ca9b3b tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:02.550977 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-c3dc3fb3-0efd-4ca0-a075-fb77e5ca9b3b tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:02.559693 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c3dc3fb3-0efd-4ca0-a075-fb77e5ca9b3b tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:02.560384 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c3dc3fb3-0efd-4ca0-a075-fb77e5ca9b3b tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:02.561663 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c3dc3fb3-0efd-4ca0-a075-fb77e5ca9b3b tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:02.562434 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c3dc3fb3-0efd-4ca0-a075-fb77e5ca9b3b tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:02.783191 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-c3dc3fb3-0efd-4ca0-a075-fb77e5ca9b3b tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed1331bcb0e4fe4a53379d1d72f650a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38faa56e5864d3aba51e1e8351e3a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:02.794526 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-c3dc3fb3-0efd-4ca0-a075-fb77e5ca9b3b tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb" status: 200 len: 1750 microversion: 2.1 time: 0.247704 Dec 15 13:36:02.802958 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 407/802] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:36:02 2021] GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb => generated 1750 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:36:03.511061 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-40260ffa-b354-4b14-afad-7d1d72fb9852 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:03.512266 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-40260ffa-b354-4b14-afad-7d1d72fb9852 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:03.523381 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-40260ffa-b354-4b14-afad-7d1d72fb9852 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:03.523831 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-40260ffa-b354-4b14-afad-7d1d72fb9852 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:03.524676 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-40260ffa-b354-4b14-afad-7d1d72fb9852 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:03.525115 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-40260ffa-b354-4b14-afad-7d1d72fb9852 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:03.747053 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-40260ffa-b354-4b14-afad-7d1d72fb9852 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:03.768784 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-40260ffa-b354-4b14-afad-7d1d72fb9852 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:03.778420 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-40260ffa-b354-4b14-afad-7d1d72fb9852 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:03.780182 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-40260ffa-b354-4b14-afad-7d1d72fb9852 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1809 microversion: 2.20 time: 0.279504 Dec 15 13:36:03.780935 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 396/803] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:36:03 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1809 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:36:03.812710 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-f1a64176-00c1-4f80-81d6-f977f32f295d tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:03.813430 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-f1a64176-00c1-4f80-81d6-f977f32f295d tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:03.820416 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f1a64176-00c1-4f80-81d6-f977f32f295d tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:03.820930 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f1a64176-00c1-4f80-81d6-f977f32f295d tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:03.821744 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f1a64176-00c1-4f80-81d6-f977f32f295d tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:03.822185 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f1a64176-00c1-4f80-81d6-f977f32f295d tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:04.380614 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-f1a64176-00c1-4f80-81d6-f977f32f295d tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed1331bcb0e4fe4a53379d1d72f650a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38faa56e5864d3aba51e1e8351e3a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:04.388977 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-f1a64176-00c1-4f80-81d6-f977f32f295d tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb" status: 200 len: 1750 microversion: 2.1 time: 0.580108 Dec 15 13:36:04.389649 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 408/804] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:36:03 2021] GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb => generated 1750 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:36:04.806705 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-34430a59-8670-451c-afd6-a3f8f26d0193 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:04.808184 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-34430a59-8670-451c-afd6-a3f8f26d0193 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:04.822367 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-34430a59-8670-451c-afd6-a3f8f26d0193 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:04.822923 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-34430a59-8670-451c-afd6-a3f8f26d0193 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:04.825634 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-34430a59-8670-451c-afd6-a3f8f26d0193 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:04.827214 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-34430a59-8670-451c-afd6-a3f8f26d0193 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:05.252461 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-34430a59-8670-451c-afd6-a3f8f26d0193 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:05.265280 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-34430a59-8670-451c-afd6-a3f8f26d0193 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:05.266938 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-34430a59-8670-451c-afd6-a3f8f26d0193 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:05.269972 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-34430a59-8670-451c-afd6-a3f8f26d0193 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1809 microversion: 2.20 time: 0.468041 Dec 15 13:36:05.286725 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 397/805] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:36:04 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1809 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:36:05.415218 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-52ea3708-03c8-4566-871a-e22dc7cd29e0 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:05.419771 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-52ea3708-03c8-4566-871a-e22dc7cd29e0 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:05.436726 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-52ea3708-03c8-4566-871a-e22dc7cd29e0 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:05.437437 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-52ea3708-03c8-4566-871a-e22dc7cd29e0 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:05.438453 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-52ea3708-03c8-4566-871a-e22dc7cd29e0 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:05.439546 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-52ea3708-03c8-4566-871a-e22dc7cd29e0 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:05.668024 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-52ea3708-03c8-4566-871a-e22dc7cd29e0 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed1331bcb0e4fe4a53379d1d72f650a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38faa56e5864d3aba51e1e8351e3a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:05.683521 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-52ea3708-03c8-4566-871a-e22dc7cd29e0 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb" status: 200 len: 1750 microversion: 2.1 time: 0.276539 Dec 15 13:36:05.695757 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 409/806] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:36:05 2021] GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb => generated 1750 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:36:06.623654 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-3eac91e2-888f-4eb8-911e-cd554262982e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:06.624264 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-3eac91e2-888f-4eb8-911e-cd554262982e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:06.630834 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3eac91e2-888f-4eb8-911e-cd554262982e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:06.631382 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3eac91e2-888f-4eb8-911e-cd554262982e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:06.632405 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3eac91e2-888f-4eb8-911e-cd554262982e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:06.633033 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3eac91e2-888f-4eb8-911e-cd554262982e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:06.713197 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-523bcf13-3196-460a-9f2e-7c3475833ed2 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:06.713944 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-523bcf13-3196-460a-9f2e-7c3475833ed2 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:06.722238 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-523bcf13-3196-460a-9f2e-7c3475833ed2 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:06.722939 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-523bcf13-3196-460a-9f2e-7c3475833ed2 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:06.723886 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-523bcf13-3196-460a-9f2e-7c3475833ed2 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:06.724511 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-523bcf13-3196-460a-9f2e-7c3475833ed2 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:06.840834 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-3eac91e2-888f-4eb8-911e-cd554262982e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:06.855398 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-3eac91e2-888f-4eb8-911e-cd554262982e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:06.859117 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-3eac91e2-888f-4eb8-911e-cd554262982e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:06.866476 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-3eac91e2-888f-4eb8-911e-cd554262982e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1809 microversion: 2.20 time: 0.577020 Dec 15 13:36:06.867468 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 398/807] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:36:06 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1809 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:36:06.946746 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-523bcf13-3196-460a-9f2e-7c3475833ed2 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed1331bcb0e4fe4a53379d1d72f650a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38faa56e5864d3aba51e1e8351e3a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:06.955223 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-523bcf13-3196-460a-9f2e-7c3475833ed2 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb" status: 200 len: 1755 microversion: 2.1 time: 0.246556 Dec 15 13:36:06.956376 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 410/808] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:36:06 2021] GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb => generated 1755 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:36:07.677891 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-ed4cc3b3-bea6-4a13-9f8a-bc488155a64d tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Action: 'create', calling method: .version_select at 0x7ff50f2f9160>, body: {"keypair": {"name": "tempest-TestShelveInstance-1407100669"}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:36:07.695342 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-ed4cc3b3-bea6-4a13-9f8a-bc488155a64d tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Getting quotas for project bb0ac6d4548e486492887beb2e915bdb. Resources: {'key_pairs'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:36:07.699475 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-ed4cc3b3-bea6-4a13-9f8a-bc488155a64d tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Getting quotas for user 7774ea10bce345cabd96a0c94eda98b3 and project bb0ac6d4548e486492887beb2e915bdb. Resources: {'key_pairs'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:36:07.805013 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-ed4cc3b3-bea6-4a13-9f8a-bc488155a64d tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Getting quotas for project bb0ac6d4548e486492887beb2e915bdb. Resources: {'key_pairs'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:36:07.808609 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-ed4cc3b3-bea6-4a13-9f8a-bc488155a64d tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Getting quotas for user 7774ea10bce345cabd96a0c94eda98b3 and project bb0ac6d4548e486492887beb2e915bdb. Resources: {'key_pairs'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:36:07.822181 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-ed4cc3b3-bea6-4a13-9f8a-bc488155a64d tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.273958 Dec 15 13:36:07.822791 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 399/809] 10.222.0.60 () {60 vars in 1157 bytes} [Wed Dec 15 13:36:07 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:36:07.884985 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-e820293a-dac1-4058-a1ba-f826877dd147 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:07.885609 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-e820293a-dac1-4058-a1ba-f826877dd147 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:07.892896 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e820293a-dac1-4058-a1ba-f826877dd147 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:07.893645 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e820293a-dac1-4058-a1ba-f826877dd147 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:07.894443 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e820293a-dac1-4058-a1ba-f826877dd147 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:07.894942 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e820293a-dac1-4058-a1ba-f826877dd147 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:07.973901 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-541b7941-5a4f-462f-9c35-b8793e812d9b tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:07.974615 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-541b7941-5a4f-462f-9c35-b8793e812d9b tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:07.982192 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-541b7941-5a4f-462f-9c35-b8793e812d9b tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:07.982642 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-541b7941-5a4f-462f-9c35-b8793e812d9b tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:07.983748 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-541b7941-5a4f-462f-9c35-b8793e812d9b tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:07.984410 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-541b7941-5a4f-462f-9c35-b8793e812d9b tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:08.140537 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-e820293a-dac1-4058-a1ba-f826877dd147 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:08.149395 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-e820293a-dac1-4058-a1ba-f826877dd147 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:08.151093 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-e820293a-dac1-4058-a1ba-f826877dd147 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:08.152402 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-e820293a-dac1-4058-a1ba-f826877dd147 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1809 microversion: 2.20 time: 0.271275 Dec 15 13:36:08.153368 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 411/810] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:36:07 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1809 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:36:08.281712 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-541b7941-5a4f-462f-9c35-b8793e812d9b tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed1331bcb0e4fe4a53379d1d72f650a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38faa56e5864d3aba51e1e8351e3a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:08.291374 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-541b7941-5a4f-462f-9c35-b8793e812d9b tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb" status: 200 len: 1755 microversion: 2.1 time: 0.321566 Dec 15 13:36:08.293072 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 400/811] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:36:07 2021] GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb => generated 1755 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:36:09.172573 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-68d0c105-d2af-417b-a270-b92807eb1b14 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:09.173718 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-68d0c105-d2af-417b-a270-b92807eb1b14 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:09.180086 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-68d0c105-d2af-417b-a270-b92807eb1b14 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:09.180782 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-68d0c105-d2af-417b-a270-b92807eb1b14 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:09.181895 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-68d0c105-d2af-417b-a270-b92807eb1b14 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:09.182904 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-68d0c105-d2af-417b-a270-b92807eb1b14 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:09.310610 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-9b6d6455-281e-4f1a-8ec2-96e6dcc7a629 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:09.311590 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-9b6d6455-281e-4f1a-8ec2-96e6dcc7a629 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:09.322001 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9b6d6455-281e-4f1a-8ec2-96e6dcc7a629 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:09.325461 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9b6d6455-281e-4f1a-8ec2-96e6dcc7a629 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:09.326332 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9b6d6455-281e-4f1a-8ec2-96e6dcc7a629 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:09.326765 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9b6d6455-281e-4f1a-8ec2-96e6dcc7a629 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:09.386485 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-68d0c105-d2af-417b-a270-b92807eb1b14 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:09.396884 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-68d0c105-d2af-417b-a270-b92807eb1b14 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:09.400642 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-68d0c105-d2af-417b-a270-b92807eb1b14 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:09.402233 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-68d0c105-d2af-417b-a270-b92807eb1b14 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1809 microversion: 2.20 time: 0.235192 Dec 15 13:36:09.402948 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 412/812] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:36:09 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1809 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:36:09.499208 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-9b6d6455-281e-4f1a-8ec2-96e6dcc7a629 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed1331bcb0e4fe4a53379d1d72f650a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38faa56e5864d3aba51e1e8351e3a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:09.507216 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-9b6d6455-281e-4f1a-8ec2-96e6dcc7a629 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb" status: 200 len: 1755 microversion: 2.1 time: 0.200908 Dec 15 13:36:09.507884 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 401/813] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:36:09 2021] GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb => generated 1755 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:36:10.422442 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-dac7b3db-950b-4694-88ca-2a4e531765c9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:10.423101 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-dac7b3db-950b-4694-88ca-2a4e531765c9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:10.430272 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-dac7b3db-950b-4694-88ca-2a4e531765c9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:10.430707 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-dac7b3db-950b-4694-88ca-2a4e531765c9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:10.431536 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-dac7b3db-950b-4694-88ca-2a4e531765c9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:10.431979 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-dac7b3db-950b-4694-88ca-2a4e531765c9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:10.525148 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-8db7c3a7-539e-4ad7-b9cd-2ad055acf8bc tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:10.526407 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-8db7c3a7-539e-4ad7-b9cd-2ad055acf8bc tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:10.533253 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8db7c3a7-539e-4ad7-b9cd-2ad055acf8bc tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:10.535419 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8db7c3a7-539e-4ad7-b9cd-2ad055acf8bc tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:10.536422 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8db7c3a7-539e-4ad7-b9cd-2ad055acf8bc tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:10.537033 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8db7c3a7-539e-4ad7-b9cd-2ad055acf8bc tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:10.572246 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-dac7b3db-950b-4694-88ca-2a4e531765c9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:10.581632 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-dac7b3db-950b-4694-88ca-2a4e531765c9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:10.585357 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-dac7b3db-950b-4694-88ca-2a4e531765c9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:10.586927 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-dac7b3db-950b-4694-88ca-2a4e531765c9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1809 microversion: 2.20 time: 0.169639 Dec 15 13:36:10.598615 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 413/814] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:36:10 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1809 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:36:10.698973 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-8db7c3a7-539e-4ad7-b9cd-2ad055acf8bc tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed1331bcb0e4fe4a53379d1d72f650a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38faa56e5864d3aba51e1e8351e3a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:10.709228 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-8db7c3a7-539e-4ad7-b9cd-2ad055acf8bc tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb" status: 200 len: 1755 microversion: 2.1 time: 0.187601 Dec 15 13:36:10.709826 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 402/815] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:36:10 2021] GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb => generated 1755 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:36:11.606397 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-555d32ce-0dcd-408d-9696-173cc666435b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:11.607169 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-555d32ce-0dcd-408d-9696-173cc666435b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:11.613611 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-555d32ce-0dcd-408d-9696-173cc666435b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:11.614140 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-555d32ce-0dcd-408d-9696-173cc666435b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:11.615060 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-555d32ce-0dcd-408d-9696-173cc666435b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:11.615597 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-555d32ce-0dcd-408d-9696-173cc666435b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:11.726815 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-df423ce1-c85f-4465-bd02-e26aa8d676eb tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:11.727444 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-df423ce1-c85f-4465-bd02-e26aa8d676eb tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:11.734632 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-df423ce1-c85f-4465-bd02-e26aa8d676eb tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:11.735100 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-df423ce1-c85f-4465-bd02-e26aa8d676eb tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:11.735902 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-df423ce1-c85f-4465-bd02-e26aa8d676eb tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:11.736336 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-df423ce1-c85f-4465-bd02-e26aa8d676eb tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:11.755679 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-555d32ce-0dcd-408d-9696-173cc666435b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:11.765326 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-555d32ce-0dcd-408d-9696-173cc666435b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:11.766868 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-555d32ce-0dcd-408d-9696-173cc666435b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:11.768057 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-555d32ce-0dcd-408d-9696-173cc666435b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1809 microversion: 2.20 time: 0.166355 Dec 15 13:36:11.779395 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 414/816] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:36:11 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:36:11.893744 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-df423ce1-c85f-4465-bd02-e26aa8d676eb tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed1331bcb0e4fe4a53379d1d72f650a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38faa56e5864d3aba51e1e8351e3a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:11.904599 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-df423ce1-c85f-4465-bd02-e26aa8d676eb tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb" status: 200 len: 1755 microversion: 2.1 time: 0.179817 Dec 15 13:36:11.905221 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 403/817] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:36:11 2021] GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb => generated 1755 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:36:12.787811 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ce028966-c764-4ce5-9b05-7df573b041ed tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:12.789134 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ce028966-c764-4ce5-9b05-7df573b041ed tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:12.796535 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ce028966-c764-4ce5-9b05-7df573b041ed tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:12.796983 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ce028966-c764-4ce5-9b05-7df573b041ed tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:12.797769 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ce028966-c764-4ce5-9b05-7df573b041ed tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:12.798203 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ce028966-c764-4ce5-9b05-7df573b041ed tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:12.924956 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-29e1eac9-0d29-4070-a2f1-61779145da45 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:12.925869 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-29e1eac9-0d29-4070-a2f1-61779145da45 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:12.930812 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-ce028966-c764-4ce5-9b05-7df573b041ed tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:12.935944 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-29e1eac9-0d29-4070-a2f1-61779145da45 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:12.936410 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-29e1eac9-0d29-4070-a2f1-61779145da45 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:12.937269 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-29e1eac9-0d29-4070-a2f1-61779145da45 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:12.937630 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-29e1eac9-0d29-4070-a2f1-61779145da45 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:12.940227 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-ce028966-c764-4ce5-9b05-7df573b041ed tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:12.941948 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-ce028966-c764-4ce5-9b05-7df573b041ed tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:12.943361 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ce028966-c764-4ce5-9b05-7df573b041ed tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1809 microversion: 2.20 time: 0.160016 Dec 15 13:36:12.944421 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 415/818] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:36:12 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:36:13.086445 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-29e1eac9-0d29-4070-a2f1-61779145da45 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed1331bcb0e4fe4a53379d1d72f650a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38faa56e5864d3aba51e1e8351e3a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:13.096083 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-29e1eac9-0d29-4070-a2f1-61779145da45 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb" status: 200 len: 1755 microversion: 2.1 time: 0.178052 Dec 15 13:36:13.096883 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 404/819] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:36:12 2021] GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb => generated 1755 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:36:13.961343 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-7a04be6d-4749-4f9f-a3c4-154a4a5495f3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:13.961965 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-7a04be6d-4749-4f9f-a3c4-154a4a5495f3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:13.968657 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7a04be6d-4749-4f9f-a3c4-154a4a5495f3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:13.969119 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7a04be6d-4749-4f9f-a3c4-154a4a5495f3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:13.969918 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7a04be6d-4749-4f9f-a3c4-154a4a5495f3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:13.970479 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7a04be6d-4749-4f9f-a3c4-154a4a5495f3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:14.105427 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-7a04be6d-4749-4f9f-a3c4-154a4a5495f3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:14.114411 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-7a04be6d-4749-4f9f-a3c4-154a4a5495f3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:14.115941 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-7a04be6d-4749-4f9f-a3c4-154a4a5495f3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:14.117111 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-7a04be6d-4749-4f9f-a3c4-154a4a5495f3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1809 microversion: 2.20 time: 0.159487 Dec 15 13:36:14.117687 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 416/820] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:36:13 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:36:14.124296 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-2d762cfc-de96-4f91-b296-06c3e5897741 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:14.124915 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-2d762cfc-de96-4f91-b296-06c3e5897741 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:14.131989 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2d762cfc-de96-4f91-b296-06c3e5897741 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:14.132455 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2d762cfc-de96-4f91-b296-06c3e5897741 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:14.133630 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2d762cfc-de96-4f91-b296-06c3e5897741 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:14.134075 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2d762cfc-de96-4f91-b296-06c3e5897741 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:14.282047 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-2d762cfc-de96-4f91-b296-06c3e5897741 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed1331bcb0e4fe4a53379d1d72f650a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38faa56e5864d3aba51e1e8351e3a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:14.289818 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-2d762cfc-de96-4f91-b296-06c3e5897741 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb" status: 200 len: 1755 microversion: 2.1 time: 0.169718 Dec 15 13:36:14.290393 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 405/821] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:36:14 2021] GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:36:15.136431 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-942ce0ba-035e-4be9-9e71-3bbb9af0a8ee tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:15.137564 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-942ce0ba-035e-4be9-9e71-3bbb9af0a8ee tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:15.144357 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-942ce0ba-035e-4be9-9e71-3bbb9af0a8ee tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:15.144824 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-942ce0ba-035e-4be9-9e71-3bbb9af0a8ee tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:15.145688 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-942ce0ba-035e-4be9-9e71-3bbb9af0a8ee tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:15.146186 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-942ce0ba-035e-4be9-9e71-3bbb9af0a8ee tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:15.287327 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-942ce0ba-035e-4be9-9e71-3bbb9af0a8ee tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:15.295332 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-942ce0ba-035e-4be9-9e71-3bbb9af0a8ee tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:15.296819 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-942ce0ba-035e-4be9-9e71-3bbb9af0a8ee tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:15.297954 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-942ce0ba-035e-4be9-9e71-3bbb9af0a8ee tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1809 microversion: 2.20 time: 0.165237 Dec 15 13:36:15.298517 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 417/822] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:36:15 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:36:15.309640 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-4fe32314-b822-46d7-b3f3-5f087c1e1be6 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:15.310269 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-4fe32314-b822-46d7-b3f3-5f087c1e1be6 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:15.316652 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4fe32314-b822-46d7-b3f3-5f087c1e1be6 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:15.317108 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4fe32314-b822-46d7-b3f3-5f087c1e1be6 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:15.317892 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4fe32314-b822-46d7-b3f3-5f087c1e1be6 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:15.318336 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4fe32314-b822-46d7-b3f3-5f087c1e1be6 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:15.466187 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-4fe32314-b822-46d7-b3f3-5f087c1e1be6 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed1331bcb0e4fe4a53379d1d72f650a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38faa56e5864d3aba51e1e8351e3a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:15.474034 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-4fe32314-b822-46d7-b3f3-5f087c1e1be6 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb" status: 200 len: 1755 microversion: 2.1 time: 0.168652 Dec 15 13:36:15.474599 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 406/823] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:36:15 2021] GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:36:16.318347 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-47a0bdfc-76c4-49d7-9af4-b5874071e81e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:16.319106 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-47a0bdfc-76c4-49d7-9af4-b5874071e81e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:16.327252 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-47a0bdfc-76c4-49d7-9af4-b5874071e81e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:16.327710 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-47a0bdfc-76c4-49d7-9af4-b5874071e81e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:16.328548 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-47a0bdfc-76c4-49d7-9af4-b5874071e81e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:16.329048 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-47a0bdfc-76c4-49d7-9af4-b5874071e81e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:16.469924 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-47a0bdfc-76c4-49d7-9af4-b5874071e81e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:16.481460 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-47a0bdfc-76c4-49d7-9af4-b5874071e81e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:16.483004 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-47a0bdfc-76c4-49d7-9af4-b5874071e81e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:16.484213 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-47a0bdfc-76c4-49d7-9af4-b5874071e81e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1809 microversion: 2.20 time: 0.169690 Dec 15 13:36:16.486175 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 418/824] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:36:16 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:36:16.491363 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-35fa8f5c-36d1-4bd0-b02b-888f537e89c3 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:16.491973 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-35fa8f5c-36d1-4bd0-b02b-888f537e89c3 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:16.499146 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-35fa8f5c-36d1-4bd0-b02b-888f537e89c3 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:16.499604 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-35fa8f5c-36d1-4bd0-b02b-888f537e89c3 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:16.500439 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-35fa8f5c-36d1-4bd0-b02b-888f537e89c3 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:16.500883 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-35fa8f5c-36d1-4bd0-b02b-888f537e89c3 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:16.656048 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-35fa8f5c-36d1-4bd0-b02b-888f537e89c3 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed1331bcb0e4fe4a53379d1d72f650a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38faa56e5864d3aba51e1e8351e3a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:16.664252 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-35fa8f5c-36d1-4bd0-b02b-888f537e89c3 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb" status: 200 len: 1755 microversion: 2.1 time: 0.176709 Dec 15 13:36:16.664830 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 407/825] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:36:16 2021] GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb => generated 1755 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:36:17.501911 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-d3b9ce80-b69d-46f5-8001-1f21380331e8 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:17.502510 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-d3b9ce80-b69d-46f5-8001-1f21380331e8 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:17.508753 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d3b9ce80-b69d-46f5-8001-1f21380331e8 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:17.509198 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d3b9ce80-b69d-46f5-8001-1f21380331e8 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:17.509972 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d3b9ce80-b69d-46f5-8001-1f21380331e8 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:17.510406 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d3b9ce80-b69d-46f5-8001-1f21380331e8 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:17.657854 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-d3b9ce80-b69d-46f5-8001-1f21380331e8 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:17.672059 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-d3b9ce80-b69d-46f5-8001-1f21380331e8 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:17.675053 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-d3b9ce80-b69d-46f5-8001-1f21380331e8 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:17.676563 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-d3b9ce80-b69d-46f5-8001-1f21380331e8 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1809 microversion: 2.20 time: 0.178126 Dec 15 13:36:17.677195 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 419/826] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:36:17 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:36:17.681654 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-db3877b0-203b-4337-babe-430674d4ed39 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:17.682273 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-db3877b0-203b-4337-babe-430674d4ed39 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:17.689264 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-db3877b0-203b-4337-babe-430674d4ed39 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:17.689727 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-db3877b0-203b-4337-babe-430674d4ed39 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:17.690522 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-db3877b0-203b-4337-babe-430674d4ed39 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:17.690998 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-db3877b0-203b-4337-babe-430674d4ed39 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:17.837641 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-db3877b0-203b-4337-babe-430674d4ed39 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed1331bcb0e4fe4a53379d1d72f650a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38faa56e5864d3aba51e1e8351e3a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:17.845344 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-db3877b0-203b-4337-babe-430674d4ed39 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb" status: 200 len: 1755 microversion: 2.1 time: 0.167341 Dec 15 13:36:17.845916 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 408/827] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:36:17 2021] GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:36:18.695212 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-87f07fd7-a946-4dbe-9df7-662e6d6b031f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:18.695854 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-87f07fd7-a946-4dbe-9df7-662e6d6b031f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:18.702081 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-87f07fd7-a946-4dbe-9df7-662e6d6b031f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:18.702531 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-87f07fd7-a946-4dbe-9df7-662e6d6b031f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:18.703347 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-87f07fd7-a946-4dbe-9df7-662e6d6b031f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:18.703787 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-87f07fd7-a946-4dbe-9df7-662e6d6b031f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:18.835161 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-87f07fd7-a946-4dbe-9df7-662e6d6b031f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:18.843586 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-87f07fd7-a946-4dbe-9df7-662e6d6b031f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:18.845091 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-87f07fd7-a946-4dbe-9df7-662e6d6b031f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:18.846262 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-87f07fd7-a946-4dbe-9df7-662e6d6b031f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1809 microversion: 2.20 time: 0.155072 Dec 15 13:36:18.847073 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 420/828] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:36:18 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:36:18.862235 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-c0ebe926-7f17-4256-8938-3b305e29e29b tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:18.863410 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-c0ebe926-7f17-4256-8938-3b305e29e29b tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:18.869907 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c0ebe926-7f17-4256-8938-3b305e29e29b tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:18.870339 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c0ebe926-7f17-4256-8938-3b305e29e29b tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:18.871190 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c0ebe926-7f17-4256-8938-3b305e29e29b tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:18.872212 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c0ebe926-7f17-4256-8938-3b305e29e29b tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:19.022967 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-c0ebe926-7f17-4256-8938-3b305e29e29b tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed1331bcb0e4fe4a53379d1d72f650a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38faa56e5864d3aba51e1e8351e3a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:19.032148 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-c0ebe926-7f17-4256-8938-3b305e29e29b tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb" status: 200 len: 1755 microversion: 2.1 time: 0.173430 Dec 15 13:36:19.032720 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 409/829] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:36:18 2021] GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:36:19.865397 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-f2b472db-ac3d-423c-b742-4139ef7fd842 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:19.866106 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-f2b472db-ac3d-423c-b742-4139ef7fd842 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:19.873573 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f2b472db-ac3d-423c-b742-4139ef7fd842 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:19.874228 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f2b472db-ac3d-423c-b742-4139ef7fd842 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:19.875084 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f2b472db-ac3d-423c-b742-4139ef7fd842 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:19.875538 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f2b472db-ac3d-423c-b742-4139ef7fd842 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:20.023877 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-f2b472db-ac3d-423c-b742-4139ef7fd842 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:20.036056 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-f2b472db-ac3d-423c-b742-4139ef7fd842 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:20.037863 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-f2b472db-ac3d-423c-b742-4139ef7fd842 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:20.039100 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-f2b472db-ac3d-423c-b742-4139ef7fd842 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1809 microversion: 2.20 time: 0.177490 Dec 15 13:36:20.039684 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 421/830] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:36:19 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:36:20.053942 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-30c039e3-86d2-44f3-81bb-3bd533192a9a tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:20.054561 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-30c039e3-86d2-44f3-81bb-3bd533192a9a tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:20.061120 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-30c039e3-86d2-44f3-81bb-3bd533192a9a tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:20.061571 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-30c039e3-86d2-44f3-81bb-3bd533192a9a tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:20.062362 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-30c039e3-86d2-44f3-81bb-3bd533192a9a tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:20.062799 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-30c039e3-86d2-44f3-81bb-3bd533192a9a tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:20.223294 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-30c039e3-86d2-44f3-81bb-3bd533192a9a tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed1331bcb0e4fe4a53379d1d72f650a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38faa56e5864d3aba51e1e8351e3a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:20.231748 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-30c039e3-86d2-44f3-81bb-3bd533192a9a tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb" status: 200 len: 1755 microversion: 2.1 time: 0.185451 Dec 15 13:36:20.232343 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 410/831] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:36:20 2021] GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb => generated 1755 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:36:21.057121 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-95d806d2-1972-4b25-99de-88d275647b5b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:21.057845 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-95d806d2-1972-4b25-99de-88d275647b5b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:21.064708 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-95d806d2-1972-4b25-99de-88d275647b5b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:21.065170 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-95d806d2-1972-4b25-99de-88d275647b5b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:21.065970 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-95d806d2-1972-4b25-99de-88d275647b5b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:21.066414 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-95d806d2-1972-4b25-99de-88d275647b5b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:21.200463 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-95d806d2-1972-4b25-99de-88d275647b5b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:21.208509 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-95d806d2-1972-4b25-99de-88d275647b5b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:21.209983 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-95d806d2-1972-4b25-99de-88d275647b5b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:21.211151 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-95d806d2-1972-4b25-99de-88d275647b5b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1809 microversion: 2.20 time: 0.157743 Dec 15 13:36:21.211715 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 422/832] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:36:21 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:36:21.249045 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-20ebec4a-d142-47be-8513-fe01d961abfc tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:21.249686 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-20ebec4a-d142-47be-8513-fe01d961abfc tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:21.256053 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-20ebec4a-d142-47be-8513-fe01d961abfc tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:21.256498 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-20ebec4a-d142-47be-8513-fe01d961abfc tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:21.257277 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-20ebec4a-d142-47be-8513-fe01d961abfc tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:21.257713 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-20ebec4a-d142-47be-8513-fe01d961abfc tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:21.405464 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-20ebec4a-d142-47be-8513-fe01d961abfc tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed1331bcb0e4fe4a53379d1d72f650a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38faa56e5864d3aba51e1e8351e3a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:21.413440 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-20ebec4a-d142-47be-8513-fe01d961abfc tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb" status: 200 len: 1755 microversion: 2.1 time: 0.168189 Dec 15 13:36:21.414020 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 411/833] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:36:21 2021] GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:36:22.230284 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-0a969808-52f4-4e73-b882-9d4e06fb33fe tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:22.231045 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-0a969808-52f4-4e73-b882-9d4e06fb33fe tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:22.237235 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0a969808-52f4-4e73-b882-9d4e06fb33fe tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:22.237718 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0a969808-52f4-4e73-b882-9d4e06fb33fe tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:22.238521 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0a969808-52f4-4e73-b882-9d4e06fb33fe tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:22.238986 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0a969808-52f4-4e73-b882-9d4e06fb33fe tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:22.372889 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-0a969808-52f4-4e73-b882-9d4e06fb33fe tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:22.381175 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-0a969808-52f4-4e73-b882-9d4e06fb33fe tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:22.382731 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-0a969808-52f4-4e73-b882-9d4e06fb33fe tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:22.383922 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-0a969808-52f4-4e73-b882-9d4e06fb33fe tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1809 microversion: 2.20 time: 0.157471 Dec 15 13:36:22.384493 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 423/834] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:36:22 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:36:22.431610 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-3a0876a6-06bf-43ea-afc1-a9cad1b67a03 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:22.432218 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-3a0876a6-06bf-43ea-afc1-a9cad1b67a03 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:22.438993 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3a0876a6-06bf-43ea-afc1-a9cad1b67a03 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:22.439444 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3a0876a6-06bf-43ea-afc1-a9cad1b67a03 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:22.440230 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3a0876a6-06bf-43ea-afc1-a9cad1b67a03 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:22.440667 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3a0876a6-06bf-43ea-afc1-a9cad1b67a03 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:22.581218 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-3a0876a6-06bf-43ea-afc1-a9cad1b67a03 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed1331bcb0e4fe4a53379d1d72f650a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38faa56e5864d3aba51e1e8351e3a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:22.589172 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-3a0876a6-06bf-43ea-afc1-a9cad1b67a03 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb" status: 200 len: 1755 microversion: 2.1 time: 0.161200 Dec 15 13:36:22.589780 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 412/835] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:36:22 2021] GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:36:23.401961 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ba07427d-0dce-4a73-a88c-d88893580225 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:23.403136 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ba07427d-0dce-4a73-a88c-d88893580225 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:23.409559 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ba07427d-0dce-4a73-a88c-d88893580225 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:23.410018 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ba07427d-0dce-4a73-a88c-d88893580225 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:23.410806 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ba07427d-0dce-4a73-a88c-d88893580225 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:23.411279 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ba07427d-0dce-4a73-a88c-d88893580225 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:23.548094 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-ba07427d-0dce-4a73-a88c-d88893580225 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:23.556458 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-ba07427d-0dce-4a73-a88c-d88893580225 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:23.557964 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-ba07427d-0dce-4a73-a88c-d88893580225 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:23.559668 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ba07427d-0dce-4a73-a88c-d88893580225 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1809 microversion: 2.20 time: 0.161483 Dec 15 13:36:23.560232 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 424/836] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:36:23 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:36:23.607816 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-29e94009-fef2-4dc1-ac41-307adf3f6d90 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:23.608522 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-29e94009-fef2-4dc1-ac41-307adf3f6d90 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:23.616433 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-29e94009-fef2-4dc1-ac41-307adf3f6d90 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:23.616894 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-29e94009-fef2-4dc1-ac41-307adf3f6d90 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:23.617711 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-29e94009-fef2-4dc1-ac41-307adf3f6d90 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:23.618159 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-29e94009-fef2-4dc1-ac41-307adf3f6d90 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:23.779130 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-29e94009-fef2-4dc1-ac41-307adf3f6d90 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed1331bcb0e4fe4a53379d1d72f650a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38faa56e5864d3aba51e1e8351e3a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:23.786596 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-29e94009-fef2-4dc1-ac41-307adf3f6d90 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb" status: 200 len: 1755 microversion: 2.1 time: 0.182367 Dec 15 13:36:23.787228 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 413/837] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:36:23 2021] GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb => generated 1755 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:36:24.578059 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-363063f3-da94-4555-b6e0-6a048296ea45 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:24.578529 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-363063f3-da94-4555-b6e0-6a048296ea45 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:24.585031 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-363063f3-da94-4555-b6e0-6a048296ea45 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:24.585484 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-363063f3-da94-4555-b6e0-6a048296ea45 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:24.586272 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-363063f3-da94-4555-b6e0-6a048296ea45 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:24.586730 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-363063f3-da94-4555-b6e0-6a048296ea45 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:24.727310 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-363063f3-da94-4555-b6e0-6a048296ea45 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:24.736601 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-363063f3-da94-4555-b6e0-6a048296ea45 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:24.738643 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-363063f3-da94-4555-b6e0-6a048296ea45 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:24.740391 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-363063f3-da94-4555-b6e0-6a048296ea45 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1809 microversion: 2.20 time: 0.166663 Dec 15 13:36:24.749668 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 425/838] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:36:24 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:36:24.803846 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-3ffb1711-1775-42f9-8ebb-a6eba17ac830 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:24.804610 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-3ffb1711-1775-42f9-8ebb-a6eba17ac830 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:24.811581 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3ffb1711-1775-42f9-8ebb-a6eba17ac830 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:24.812036 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3ffb1711-1775-42f9-8ebb-a6eba17ac830 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:24.812831 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3ffb1711-1775-42f9-8ebb-a6eba17ac830 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:24.813267 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3ffb1711-1775-42f9-8ebb-a6eba17ac830 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:24.969704 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-3ffb1711-1775-42f9-8ebb-a6eba17ac830 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed1331bcb0e4fe4a53379d1d72f650a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38faa56e5864d3aba51e1e8351e3a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:24.978427 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-3ffb1711-1775-42f9-8ebb-a6eba17ac830 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb" status: 200 len: 1755 microversion: 2.1 time: 0.178072 Dec 15 13:36:24.979448 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 414/839] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:36:24 2021] GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb => generated 1755 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:36:25.758651 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-6f431752-6530-4346-8811-840ae93664d7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:25.759219 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-6f431752-6530-4346-8811-840ae93664d7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:25.766298 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6f431752-6530-4346-8811-840ae93664d7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:25.766758 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6f431752-6530-4346-8811-840ae93664d7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:25.767630 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6f431752-6530-4346-8811-840ae93664d7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:25.768073 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6f431752-6530-4346-8811-840ae93664d7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:25.894522 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-6f431752-6530-4346-8811-840ae93664d7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:25.902810 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-6f431752-6530-4346-8811-840ae93664d7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:25.904337 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-6f431752-6530-4346-8811-840ae93664d7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:25.905535 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-6f431752-6530-4346-8811-840ae93664d7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1809 microversion: 2.20 time: 0.150722 Dec 15 13:36:25.906107 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 426/840] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:36:25 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:36:25.995603 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-6988d436-80ed-4f27-bc20-98a717fdfcfc tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:25.996728 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-6988d436-80ed-4f27-bc20-98a717fdfcfc tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:26.003019 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6988d436-80ed-4f27-bc20-98a717fdfcfc tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:26.003481 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6988d436-80ed-4f27-bc20-98a717fdfcfc tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:26.004260 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6988d436-80ed-4f27-bc20-98a717fdfcfc tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:26.004700 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6988d436-80ed-4f27-bc20-98a717fdfcfc tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:26.147328 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-6988d436-80ed-4f27-bc20-98a717fdfcfc tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed1331bcb0e4fe4a53379d1d72f650a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38faa56e5864d3aba51e1e8351e3a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:26.156293 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-6988d436-80ed-4f27-bc20-98a717fdfcfc tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb" status: 200 len: 1758 microversion: 2.1 time: 0.164260 Dec 15 13:36:26.156904 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 415/841] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:36:25 2021] GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:36:26.923936 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-9a233750-4546-48ae-b61c-41cecc1b3d7a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:26.924478 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-9a233750-4546-48ae-b61c-41cecc1b3d7a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:26.930715 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9a233750-4546-48ae-b61c-41cecc1b3d7a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:26.931203 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9a233750-4546-48ae-b61c-41cecc1b3d7a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:26.931987 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9a233750-4546-48ae-b61c-41cecc1b3d7a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:26.932424 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9a233750-4546-48ae-b61c-41cecc1b3d7a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:27.058512 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-9a233750-4546-48ae-b61c-41cecc1b3d7a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:27.067250 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-9a233750-4546-48ae-b61c-41cecc1b3d7a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:27.068748 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-9a233750-4546-48ae-b61c-41cecc1b3d7a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:27.069925 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-9a233750-4546-48ae-b61c-41cecc1b3d7a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1809 microversion: 2.20 time: 0.149723 Dec 15 13:36:27.070744 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 427/842] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:36:26 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:36:28.088174 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-34e102b9-4cbc-41e6-b63f-983b037e03f5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:28.088779 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-34e102b9-4cbc-41e6-b63f-983b037e03f5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:28.095096 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-34e102b9-4cbc-41e6-b63f-983b037e03f5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:28.095545 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-34e102b9-4cbc-41e6-b63f-983b037e03f5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:28.096318 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-34e102b9-4cbc-41e6-b63f-983b037e03f5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:28.096780 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-34e102b9-4cbc-41e6-b63f-983b037e03f5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:28.221457 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-34e102b9-4cbc-41e6-b63f-983b037e03f5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:28.229598 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-34e102b9-4cbc-41e6-b63f-983b037e03f5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:28.231158 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-34e102b9-4cbc-41e6-b63f-983b037e03f5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:28.232326 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-34e102b9-4cbc-41e6-b63f-983b037e03f5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1809 microversion: 2.20 time: 0.147848 Dec 15 13:36:28.232887 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 416/843] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:36:28 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1809 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:36:29.250208 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-475179c8-9bff-4cdb-bf4b-4f336d675448 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:29.250922 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-475179c8-9bff-4cdb-bf4b-4f336d675448 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:29.257122 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-475179c8-9bff-4cdb-bf4b-4f336d675448 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:29.257571 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-475179c8-9bff-4cdb-bf4b-4f336d675448 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:29.258349 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-475179c8-9bff-4cdb-bf4b-4f336d675448 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:29.258784 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-475179c8-9bff-4cdb-bf4b-4f336d675448 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:29.388482 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-475179c8-9bff-4cdb-bf4b-4f336d675448 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:29.397911 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-475179c8-9bff-4cdb-bf4b-4f336d675448 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:29.399615 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-475179c8-9bff-4cdb-bf4b-4f336d675448 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:29.401562 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-475179c8-9bff-4cdb-bf4b-4f336d675448 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1809 microversion: 2.20 time: 0.154928 Dec 15 13:36:29.412920 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 428/844] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:36:29 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:36:30.420843 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-4eb0c16f-44d6-4433-94e0-7574c244c677 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:30.421509 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-4eb0c16f-44d6-4433-94e0-7574c244c677 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:30.428447 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4eb0c16f-44d6-4433-94e0-7574c244c677 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:30.428904 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4eb0c16f-44d6-4433-94e0-7574c244c677 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:30.429731 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4eb0c16f-44d6-4433-94e0-7574c244c677 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:30.430169 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4eb0c16f-44d6-4433-94e0-7574c244c677 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:30.557882 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-4eb0c16f-44d6-4433-94e0-7574c244c677 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:30.565930 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-4eb0c16f-44d6-4433-94e0-7574c244c677 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:30.567448 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-4eb0c16f-44d6-4433-94e0-7574c244c677 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:30.568587 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-4eb0c16f-44d6-4433-94e0-7574c244c677 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1809 microversion: 2.20 time: 0.152133 Dec 15 13:36:30.569148 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 417/845] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:36:30 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:36:31.586391 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-6ef545ee-2889-440f-b428-2c424a667518 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:31.587051 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-6ef545ee-2889-440f-b428-2c424a667518 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:31.593781 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6ef545ee-2889-440f-b428-2c424a667518 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:31.594253 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6ef545ee-2889-440f-b428-2c424a667518 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:31.595061 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6ef545ee-2889-440f-b428-2c424a667518 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:31.595536 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6ef545ee-2889-440f-b428-2c424a667518 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:31.725282 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-6ef545ee-2889-440f-b428-2c424a667518 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:31.733324 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-6ef545ee-2889-440f-b428-2c424a667518 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:31.734814 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-6ef545ee-2889-440f-b428-2c424a667518 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:31.735992 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-6ef545ee-2889-440f-b428-2c424a667518 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1809 microversion: 2.20 time: 0.153339 Dec 15 13:36:31.736557 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 429/846] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:36:31 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:36:32.754266 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-93e89168-4498-4659-ba54-34b1581b048c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:32.754893 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-93e89168-4498-4659-ba54-34b1581b048c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:32.761219 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-93e89168-4498-4659-ba54-34b1581b048c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:32.761679 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-93e89168-4498-4659-ba54-34b1581b048c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:32.762471 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-93e89168-4498-4659-ba54-34b1581b048c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:32.762928 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-93e89168-4498-4659-ba54-34b1581b048c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:32.890395 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-93e89168-4498-4659-ba54-34b1581b048c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:32.898732 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-93e89168-4498-4659-ba54-34b1581b048c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:32.900669 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-93e89168-4498-4659-ba54-34b1581b048c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:32.901814 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-93e89168-4498-4659-ba54-34b1581b048c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1809 microversion: 2.20 time: 0.151335 Dec 15 13:36:32.902994 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 418/847] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:36:32 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:36:33.555576 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-44da41b3-5d25-48ee-a68e-4d778aca75db req-1be8623e-3051-41ad-a805-d902e4f2a6bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00671676-47cb-4266-b9e5-61c7fb120355", "name": "network-vif-plugged", "status": "completed", "tag": "33030795-e868-427d-8a6a-6d48523668bc"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:36:33.557542 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:36:33.557542 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: warnings.warn(msg) Dec 15 13:36:33.566061 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-44da41b3-5d25-48ee-a68e-4d778aca75db req-1be8623e-3051-41ad-a805-d902e4f2a6bb service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:33.566515 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-44da41b3-5d25-48ee-a68e-4d778aca75db req-1be8623e-3051-41ad-a805-d902e4f2a6bb service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:33.579487 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-44da41b3-5d25-48ee-a68e-4d778aca75db req-1be8623e-3051-41ad-a805-d902e4f2a6bb service nova] Creating event network-vif-plugged:33030795-e868-427d-8a6a-6d48523668bc for instance 00671676-47cb-4266-b9e5-61c7fb120355 on hv-cinder-81322 Dec 15 13:36:33.584761 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-44da41b3-5d25-48ee-a68e-4d778aca75db req-1be8623e-3051-41ad-a805-d902e4f2a6bb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032791 Dec 15 13:36:33.585740 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 430/848] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:36:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:36:33.920633 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-10a69b66-3490-4334-b477-40bb7e154460 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:33.921245 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-10a69b66-3490-4334-b477-40bb7e154460 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:33.927488 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-10a69b66-3490-4334-b477-40bb7e154460 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:33.927935 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-10a69b66-3490-4334-b477-40bb7e154460 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:33.928705 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-10a69b66-3490-4334-b477-40bb7e154460 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:33.929136 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-10a69b66-3490-4334-b477-40bb7e154460 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:34.061153 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-10a69b66-3490-4334-b477-40bb7e154460 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:34.069457 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-10a69b66-3490-4334-b477-40bb7e154460 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:34.071232 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-10a69b66-3490-4334-b477-40bb7e154460 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:34.072897 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-10a69b66-3490-4334-b477-40bb7e154460 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1809 microversion: 2.20 time: 0.156257 Dec 15 13:36:34.073455 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 419/849] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:36:33 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:36:35.092723 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-877428dd-4f38-48a4-9e8d-8b76b7d25567 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:35.093452 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-877428dd-4f38-48a4-9e8d-8b76b7d25567 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:35.100240 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-877428dd-4f38-48a4-9e8d-8b76b7d25567 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:35.100626 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-877428dd-4f38-48a4-9e8d-8b76b7d25567 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:35.101423 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-877428dd-4f38-48a4-9e8d-8b76b7d25567 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:35.101867 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-877428dd-4f38-48a4-9e8d-8b76b7d25567 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:35.230669 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-877428dd-4f38-48a4-9e8d-8b76b7d25567 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:35.238806 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-877428dd-4f38-48a4-9e8d-8b76b7d25567 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:35.240321 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-877428dd-4f38-48a4-9e8d-8b76b7d25567 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:35.241473 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-877428dd-4f38-48a4-9e8d-8b76b7d25567 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1809 microversion: 2.20 time: 0.154015 Dec 15 13:36:35.242040 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 431/850] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:36:35 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:36:36.259545 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-26a4996d-5eb5-40c8-a8b4-c8ee11d1a9bc tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:36.260068 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-26a4996d-5eb5-40c8-a8b4-c8ee11d1a9bc tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:36.267107 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-26a4996d-5eb5-40c8-a8b4-c8ee11d1a9bc tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:36.267560 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-26a4996d-5eb5-40c8-a8b4-c8ee11d1a9bc tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:36.268349 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-26a4996d-5eb5-40c8-a8b4-c8ee11d1a9bc tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:36.268783 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-26a4996d-5eb5-40c8-a8b4-c8ee11d1a9bc tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:36.403259 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-26a4996d-5eb5-40c8-a8b4-c8ee11d1a9bc tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:36.411664 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-26a4996d-5eb5-40c8-a8b4-c8ee11d1a9bc tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:36.413157 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-26a4996d-5eb5-40c8-a8b4-c8ee11d1a9bc tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:36.414340 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-26a4996d-5eb5-40c8-a8b4-c8ee11d1a9bc tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1809 microversion: 2.20 time: 0.158700 Dec 15 13:36:36.414924 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 420/851] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:36:36 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:36:37.432217 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-6b44fa1d-d0c8-4a13-94c0-d2446fa24df3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:37.432757 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-6b44fa1d-d0c8-4a13-94c0-d2446fa24df3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:37.442922 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6b44fa1d-d0c8-4a13-94c0-d2446fa24df3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:37.444863 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6b44fa1d-d0c8-4a13-94c0-d2446fa24df3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:37.444863 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6b44fa1d-d0c8-4a13-94c0-d2446fa24df3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:37.444863 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6b44fa1d-d0c8-4a13-94c0-d2446fa24df3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:37.575746 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-6b44fa1d-d0c8-4a13-94c0-d2446fa24df3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:37.583973 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-6b44fa1d-d0c8-4a13-94c0-d2446fa24df3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:37.585473 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-6b44fa1d-d0c8-4a13-94c0-d2446fa24df3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:37.586618 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-6b44fa1d-d0c8-4a13-94c0-d2446fa24df3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1809 microversion: 2.20 time: 0.158190 Dec 15 13:36:37.587229 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 432/852] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:36:37 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:36:38.604645 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-356c7b08-60d6-4356-9648-2bf64f9b3ce3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:38.605362 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-356c7b08-60d6-4356-9648-2bf64f9b3ce3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:38.611610 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-356c7b08-60d6-4356-9648-2bf64f9b3ce3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:38.612062 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-356c7b08-60d6-4356-9648-2bf64f9b3ce3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:38.612841 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-356c7b08-60d6-4356-9648-2bf64f9b3ce3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:38.613283 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-356c7b08-60d6-4356-9648-2bf64f9b3ce3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:38.744074 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-356c7b08-60d6-4356-9648-2bf64f9b3ce3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:38.752933 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-356c7b08-60d6-4356-9648-2bf64f9b3ce3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:38.754543 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-356c7b08-60d6-4356-9648-2bf64f9b3ce3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:38.755719 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-356c7b08-60d6-4356-9648-2bf64f9b3ce3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1809 microversion: 2.20 time: 0.154811 Dec 15 13:36:38.756285 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 421/853] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:36:38 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:36:39.775271 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-209cc708-f0ae-4782-a341-38b0f5799b26 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:39.775890 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-209cc708-f0ae-4782-a341-38b0f5799b26 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:39.782221 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-209cc708-f0ae-4782-a341-38b0f5799b26 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:39.782670 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-209cc708-f0ae-4782-a341-38b0f5799b26 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:39.783502 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-209cc708-f0ae-4782-a341-38b0f5799b26 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:39.783939 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-209cc708-f0ae-4782-a341-38b0f5799b26 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:39.916932 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-209cc708-f0ae-4782-a341-38b0f5799b26 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:39.925894 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-209cc708-f0ae-4782-a341-38b0f5799b26 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:39.927401 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-209cc708-f0ae-4782-a341-38b0f5799b26 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:39.928545 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-209cc708-f0ae-4782-a341-38b0f5799b26 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1809 microversion: 2.20 time: 0.157048 Dec 15 13:36:39.929094 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 433/854] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:36:39 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:36:40.945818 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-ea4b052f-a673-43ed-8b3c-fa11b35e96aa tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:40.946385 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-ea4b052f-a673-43ed-8b3c-fa11b35e96aa tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:40.952666 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ea4b052f-a673-43ed-8b3c-fa11b35e96aa tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:40.953115 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ea4b052f-a673-43ed-8b3c-fa11b35e96aa tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:40.953915 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ea4b052f-a673-43ed-8b3c-fa11b35e96aa tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:40.954345 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ea4b052f-a673-43ed-8b3c-fa11b35e96aa tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:41.080376 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-ea4b052f-a673-43ed-8b3c-fa11b35e96aa tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:41.088417 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-ea4b052f-a673-43ed-8b3c-fa11b35e96aa tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:41.090512 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-ea4b052f-a673-43ed-8b3c-fa11b35e96aa tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:41.091685 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-ea4b052f-a673-43ed-8b3c-fa11b35e96aa tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1809 microversion: 2.20 time: 0.149801 Dec 15 13:36:41.092248 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 422/855] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:36:40 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:36:42.109961 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-29382bb4-cfaa-4552-9981-d8c03c7e7cb3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:42.110601 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-29382bb4-cfaa-4552-9981-d8c03c7e7cb3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:42.116985 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-29382bb4-cfaa-4552-9981-d8c03c7e7cb3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:42.117440 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-29382bb4-cfaa-4552-9981-d8c03c7e7cb3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:42.118230 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-29382bb4-cfaa-4552-9981-d8c03c7e7cb3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:42.118673 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-29382bb4-cfaa-4552-9981-d8c03c7e7cb3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:42.245211 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-29382bb4-cfaa-4552-9981-d8c03c7e7cb3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:42.253355 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-29382bb4-cfaa-4552-9981-d8c03c7e7cb3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:42.254987 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-29382bb4-cfaa-4552-9981-d8c03c7e7cb3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:42.256150 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-29382bb4-cfaa-4552-9981-d8c03c7e7cb3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1796 microversion: 2.20 time: 0.149899 Dec 15 13:36:42.256715 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 434/856] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:36:42 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1796 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:36:55.649318 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-407c6472-b469-487d-a9b2-9affbb6f1b06 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-64941343", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1407100669", "security_groups": [{"name": "tempest-secgroup-smoke-1327183954"}], "networks": [{"uuid": "f00df9de-2b8a-4b7a-a223-8114d9b06d65"}], "block_device_mapping_v2": [{"uuid": "d00111e3-79dd-4729-b15c-8b5470641bd7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:36:55.755874 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.network.neutron [None req-407c6472-b469-487d-a9b2-9affbb6f1b06 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] validate_networks() for [('f00df9de-2b8a-4b7a-a223-8114d9b06d65', None, None, None, None, None)] {{(pid=116941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:36:56.215966 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-407c6472-b469-487d-a9b2-9affbb6f1b06 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Flavor limits 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:36:56.216389 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-407c6472-b469-487d-a9b2-9affbb6f1b06 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Image limits 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:36:56.216863 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-407c6472-b469-487d-a9b2-9affbb6f1b06 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Flavor pref 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:36:56.217276 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-407c6472-b469-487d-a9b2-9affbb6f1b06 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Image pref 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:36:56.217689 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-407c6472-b469-487d-a9b2-9affbb6f1b06 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:36:56.226213 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-407c6472-b469-487d-a9b2-9affbb6f1b06 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:56.226663 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-407c6472-b469-487d-a9b2-9affbb6f1b06 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:56.227517 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-407c6472-b469-487d-a9b2-9affbb6f1b06 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:56.227953 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-407c6472-b469-487d-a9b2-9affbb6f1b06 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:56.244184 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-407c6472-b469-487d-a9b2-9affbb6f1b06 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Getting quotas for project bb0ac6d4548e486492887beb2e915bdb. Resources: {'cores', 'instances', 'ram'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:36:56.248067 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-407c6472-b469-487d-a9b2-9affbb6f1b06 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Getting quotas for user 7774ea10bce345cabd96a0c94eda98b3 and project bb0ac6d4548e486492887beb2e915bdb. Resources: {'cores', 'instances', 'ram'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:36:56.302871 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-407c6472-b469-487d-a9b2-9affbb6f1b06 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Going to run 1 instances... {{(pid=116941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:36:56.305043 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-407c6472-b469-487d-a9b2-9affbb6f1b06 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] [instance: b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d00111e3-79dd-4729-b15c-8b5470641bd7',volume_size=None,volume_type=None)] {{(pid=116941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:36:56.424439 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-407c6472-b469-487d-a9b2-9affbb6f1b06 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.778811 Dec 15 13:36:56.425270 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 423/857] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Dec 15 13:36:55 2021] POST /compute/v2.1/servers => generated 406 bytes in 780 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 13:36:56.435106 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-0dccfb09-64d6-4d68-b11d-e684c1a0c0ac tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:56.435726 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-0dccfb09-64d6-4d68-b11d-e684c1a0c0ac tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] [instance: b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:56.497219 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-0dccfb09-64d6-4d68-b11d-e684c1a0c0ac tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7774ea10bce345cabd96a0c94eda98b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ac6d4548e486492887beb2e915bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:56.504220 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-0dccfb09-64d6-4d68-b11d-e684c1a0c0ac tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] 10.222.0.60 "GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e" status: 200 len: 1087 microversion: 2.1 time: 0.073004 Dec 15 13:36:56.505030 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 435/858] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:36:56 2021] GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e => generated 1087 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:36:57.521197 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-a3d4fd25-4d55-41ca-852c-c0ee46c08b39 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:57.522436 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-a3d4fd25-4d55-41ca-852c-c0ee46c08b39 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] [instance: b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:57.530506 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a3d4fd25-4d55-41ca-852c-c0ee46c08b39 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:57.531287 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a3d4fd25-4d55-41ca-852c-c0ee46c08b39 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:57.532329 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a3d4fd25-4d55-41ca-852c-c0ee46c08b39 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:57.532994 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a3d4fd25-4d55-41ca-852c-c0ee46c08b39 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:57.612348 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-a3d4fd25-4d55-41ca-852c-c0ee46c08b39 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7774ea10bce345cabd96a0c94eda98b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ac6d4548e486492887beb2e915bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:57.621464 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-a3d4fd25-4d55-41ca-852c-c0ee46c08b39 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] 10.222.0.60 "GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e" status: 200 len: 1193 microversion: 2.1 time: 0.103713 Dec 15 13:36:57.631478 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 424/859] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:36:57 2021] GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e => generated 1193 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:36:58.639124 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-7d418386-1755-4869-a939-24e53a7021ad tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:58.640358 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-7d418386-1755-4869-a939-24e53a7021ad tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] [instance: b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:58.651232 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7d418386-1755-4869-a939-24e53a7021ad tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:58.655473 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7d418386-1755-4869-a939-24e53a7021ad tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:58.656658 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7d418386-1755-4869-a939-24e53a7021ad tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:58.657277 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7d418386-1755-4869-a939-24e53a7021ad tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:58.846930 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-7d418386-1755-4869-a939-24e53a7021ad tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7774ea10bce345cabd96a0c94eda98b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ac6d4548e486492887beb2e915bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:58.858689 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-7d418386-1755-4869-a939-24e53a7021ad tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] 10.222.0.60 "GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e" status: 200 len: 1259 microversion: 2.1 time: 0.222836 Dec 15 13:36:58.862942 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 436/860] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:36:58 2021] GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e => generated 1259 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:36:59.311142 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-66a977f2-e366-45da-b2b8-c82462d0d0ea req-afa22cf4-3e56-4b0c-bbc0-735efcd390de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e", "tag": "271b8ee8-bedb-4be5-a4e3-37b1a376fe7f"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:36:59.312703 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:36:59.312703 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: warnings.warn(msg) Dec 15 13:36:59.321662 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-66a977f2-e366-45da-b2b8-c82462d0d0ea req-afa22cf4-3e56-4b0c-bbc0-735efcd390de service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:59.322371 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-66a977f2-e366-45da-b2b8-c82462d0d0ea req-afa22cf4-3e56-4b0c-bbc0-735efcd390de service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:59.349275 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-66a977f2-e366-45da-b2b8-c82462d0d0ea req-afa22cf4-3e56-4b0c-bbc0-735efcd390de service nova] Creating event network-changed:271b8ee8-bedb-4be5-a4e3-37b1a376fe7f for instance b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e on hv-cinder-81322 Dec 15 13:36:59.355181 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-66a977f2-e366-45da-b2b8-c82462d0d0ea req-afa22cf4-3e56-4b0c-bbc0-735efcd390de service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.232092 Dec 15 13:36:59.357098 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 425/861] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:36:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:36:59.875360 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-be2a1789-4a82-48ca-955d-e06a0db9b57a tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:59.876082 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-be2a1789-4a82-48ca-955d-e06a0db9b57a tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] [instance: b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:59.882400 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-be2a1789-4a82-48ca-955d-e06a0db9b57a tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:59.882973 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-be2a1789-4a82-48ca-955d-e06a0db9b57a tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:59.883801 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-be2a1789-4a82-48ca-955d-e06a0db9b57a tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:59.884236 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-be2a1789-4a82-48ca-955d-e06a0db9b57a tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:00.028348 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-be2a1789-4a82-48ca-955d-e06a0db9b57a tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7774ea10bce345cabd96a0c94eda98b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ac6d4548e486492887beb2e915bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:00.035694 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-be2a1789-4a82-48ca-955d-e06a0db9b57a tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] 10.222.0.60 "GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e" status: 200 len: 1259 microversion: 2.1 time: 0.164098 Dec 15 13:37:00.036310 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 437/862] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:36:59 2021] GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:00.485282 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-3c348a13-e8b4-4a8e-bc01-d22018f6dfdc tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1225517822", "imageRef": "cfccedbb-7169-47ec-9bae-d4829cba54e1", "flavorRef": "452", "networks": [{"uuid": "b6a3f70f-5a71-4bc1-9b46-d5eeb134e3f0"}]}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:37:00.537128 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.network.neutron [None req-3c348a13-e8b4-4a8e-bc01-d22018f6dfdc tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] validate_networks() for [('b6a3f70f-5a71-4bc1-9b46-d5eeb134e3f0', None, None, None, None, None)] {{(pid=116941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:37:01.053210 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-2bc06666-2920-495e-a5a9-c873d28b1d93 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:01.053588 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-2bc06666-2920-495e-a5a9-c873d28b1d93 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] [instance: b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:01.054835 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-3c348a13-e8b4-4a8e-bc01-d22018f6dfdc tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Flavor limits 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:37:01.055177 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-3c348a13-e8b4-4a8e-bc01-d22018f6dfdc tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Image limits 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:37:01.055647 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-3c348a13-e8b4-4a8e-bc01-d22018f6dfdc tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Flavor pref 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:37:01.056079 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-3c348a13-e8b4-4a8e-bc01-d22018f6dfdc tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Image pref 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:37:01.056463 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-3c348a13-e8b4-4a8e-bc01-d22018f6dfdc tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:37:01.059713 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2bc06666-2920-495e-a5a9-c873d28b1d93 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:01.060236 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2bc06666-2920-495e-a5a9-c873d28b1d93 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:01.061097 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2bc06666-2920-495e-a5a9-c873d28b1d93 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:01.061638 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2bc06666-2920-495e-a5a9-c873d28b1d93 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:01.065140 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3c348a13-e8b4-4a8e-bc01-d22018f6dfdc tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:01.065589 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3c348a13-e8b4-4a8e-bc01-d22018f6dfdc tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:01.066402 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3c348a13-e8b4-4a8e-bc01-d22018f6dfdc tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:01.066879 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3c348a13-e8b4-4a8e-bc01-d22018f6dfdc tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:01.082791 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-3c348a13-e8b4-4a8e-bc01-d22018f6dfdc tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Getting quotas for project b8066a245289451b8a7cc12d4311b412. Resources: {'cores', 'instances', 'ram'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:37:01.086632 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-3c348a13-e8b4-4a8e-bc01-d22018f6dfdc tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Getting quotas for user 1fa1533801dc4fa0b79d8662414749d8 and project b8066a245289451b8a7cc12d4311b412. Resources: {'cores', 'instances', 'ram'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:37:01.097698 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-3c348a13-e8b4-4a8e-bc01-d22018f6dfdc tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Going to run 1 instances... {{(pid=116941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:37:01.100549 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-3c348a13-e8b4-4a8e-bc01-d22018f6dfdc tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] [instance: 93bf7202-d763-46e8-a6ff-ff6b87ee9ad6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cfccedbb-7169-47ec-9bae-d4829cba54e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:37:01.145133 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-3c348a13-e8b4-4a8e-bc01-d22018f6dfdc tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.664329 Dec 15 13:37:01.145952 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 426/863] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Dec 15 13:37:00 2021] POST /compute/v2.1/servers => generated 380 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 13:37:01.155683 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-fba2eb4c-e045-485d-8ecf-80cee121cb76 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:01.156291 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-fba2eb4c-e045-485d-8ecf-80cee121cb76 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] [instance: 93bf7202-d763-46e8-a6ff-ff6b87ee9ad6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:01.215854 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-fba2eb4c-e045-485d-8ecf-80cee121cb76 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa1533801dc4fa0b79d8662414749d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8066a245289451b8a7cc12d4311b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:01.225801 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-2bc06666-2920-495e-a5a9-c873d28b1d93 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7774ea10bce345cabd96a0c94eda98b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ac6d4548e486492887beb2e915bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:01.226328 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-fba2eb4c-e045-485d-8ecf-80cee121cb76 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] 10.222.0.60 "GET /compute/v2.1/servers/93bf7202-d763-46e8-a6ff-ff6b87ee9ad6" status: 200 len: 1219 microversion: 2.1 time: 0.071458 Dec 15 13:37:01.227630 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 427/864] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:01 2021] GET /compute/v2.1/servers/93bf7202-d763-46e8-a6ff-ff6b87ee9ad6 => generated 1219 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:37:01.233828 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-2bc06666-2920-495e-a5a9-c873d28b1d93 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] 10.222.0.60 "GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e" status: 200 len: 1259 microversion: 2.1 time: 0.184774 Dec 15 13:37:01.234664 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 438/865] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:01 2021] GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e => generated 1259 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:37:02.244824 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-0a18818a-daac-4e5b-a21f-c3edd6134700 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:02.245522 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-0a18818a-daac-4e5b-a21f-c3edd6134700 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] [instance: 93bf7202-d763-46e8-a6ff-ff6b87ee9ad6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:02.250745 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-0905fdb9-9298-4fb7-acb4-3de710e9ba1f tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:02.251516 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-0905fdb9-9298-4fb7-acb4-3de710e9ba1f tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] [instance: b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:02.252846 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0a18818a-daac-4e5b-a21f-c3edd6134700 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:02.253302 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0a18818a-daac-4e5b-a21f-c3edd6134700 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:02.254109 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0a18818a-daac-4e5b-a21f-c3edd6134700 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:02.254556 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0a18818a-daac-4e5b-a21f-c3edd6134700 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:02.258372 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0905fdb9-9298-4fb7-acb4-3de710e9ba1f tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:02.259114 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0905fdb9-9298-4fb7-acb4-3de710e9ba1f tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:02.260020 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0905fdb9-9298-4fb7-acb4-3de710e9ba1f tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:02.260537 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0905fdb9-9298-4fb7-acb4-3de710e9ba1f tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:02.326378 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-0a18818a-daac-4e5b-a21f-c3edd6134700 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa1533801dc4fa0b79d8662414749d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8066a245289451b8a7cc12d4311b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:02.334060 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-0a18818a-daac-4e5b-a21f-c3edd6134700 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] 10.222.0.60 "GET /compute/v2.1/servers/93bf7202-d763-46e8-a6ff-ff6b87ee9ad6" status: 200 len: 1277 microversion: 2.1 time: 0.092718 Dec 15 13:37:02.334876 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 428/866] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:02 2021] GET /compute/v2.1/servers/93bf7202-d763-46e8-a6ff-ff6b87ee9ad6 => generated 1277 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:02.414723 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-0905fdb9-9298-4fb7-acb4-3de710e9ba1f tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7774ea10bce345cabd96a0c94eda98b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ac6d4548e486492887beb2e915bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:02.422236 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-0905fdb9-9298-4fb7-acb4-3de710e9ba1f tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] 10.222.0.60 "GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e" status: 200 len: 1259 microversion: 2.1 time: 0.175217 Dec 15 13:37:02.432951 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 439/867] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:02 2021] GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e => generated 1259 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:37:03.352116 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-93a50090-5694-4f5d-a999-21612537875f tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:03.352681 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-93a50090-5694-4f5d-a999-21612537875f tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] [instance: 93bf7202-d763-46e8-a6ff-ff6b87ee9ad6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:03.359225 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-93a50090-5694-4f5d-a999-21612537875f tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:03.359684 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-93a50090-5694-4f5d-a999-21612537875f tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:03.360484 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-93a50090-5694-4f5d-a999-21612537875f tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:03.360928 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-93a50090-5694-4f5d-a999-21612537875f tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:03.444087 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-92f778dd-c2a3-4a09-af6b-3e305e85933a tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:03.444822 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-92f778dd-c2a3-4a09-af6b-3e305e85933a tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] [instance: b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:03.456366 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-92f778dd-c2a3-4a09-af6b-3e305e85933a tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:03.457150 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-92f778dd-c2a3-4a09-af6b-3e305e85933a tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:03.458417 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-92f778dd-c2a3-4a09-af6b-3e305e85933a tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:03.459053 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-92f778dd-c2a3-4a09-af6b-3e305e85933a tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:03.520736 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-93a50090-5694-4f5d-a999-21612537875f tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa1533801dc4fa0b79d8662414749d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8066a245289451b8a7cc12d4311b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:03.528457 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-93a50090-5694-4f5d-a999-21612537875f tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] 10.222.0.60 "GET /compute/v2.1/servers/93bf7202-d763-46e8-a6ff-ff6b87ee9ad6" status: 200 len: 1319 microversion: 2.1 time: 0.180167 Dec 15 13:37:03.529166 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 429/868] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:03 2021] GET /compute/v2.1/servers/93bf7202-d763-46e8-a6ff-ff6b87ee9ad6 => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:03.534459 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-007057db-a2b1-4840-9f1d-80d2b7b1c21e req-b3140b81-b566-4ddc-9b69-f04814738fea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93bf7202-d763-46e8-a6ff-ff6b87ee9ad6", "tag": "fb1dabff-ae3a-4d15-a31e-f209b3bfbd0f"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:37:03.536429 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:37:03.536429 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: warnings.warn(msg) Dec 15 13:37:03.544799 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-007057db-a2b1-4840-9f1d-80d2b7b1c21e req-b3140b81-b566-4ddc-9b69-f04814738fea service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:03.545248 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-007057db-a2b1-4840-9f1d-80d2b7b1c21e req-b3140b81-b566-4ddc-9b69-f04814738fea service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:03.556546 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-007057db-a2b1-4840-9f1d-80d2b7b1c21e req-b3140b81-b566-4ddc-9b69-f04814738fea service nova] Creating event network-changed:fb1dabff-ae3a-4d15-a31e-f209b3bfbd0f for instance 93bf7202-d763-46e8-a6ff-ff6b87ee9ad6 on hv-cinder-81322 Dec 15 13:37:03.562003 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-007057db-a2b1-4840-9f1d-80d2b7b1c21e req-b3140b81-b566-4ddc-9b69-f04814738fea service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031306 Dec 15 13:37:03.562766 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 430/869] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:37:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:37:03.612930 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-92f778dd-c2a3-4a09-af6b-3e305e85933a tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7774ea10bce345cabd96a0c94eda98b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ac6d4548e486492887beb2e915bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:03.620379 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-92f778dd-c2a3-4a09-af6b-3e305e85933a tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] 10.222.0.60 "GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e" status: 200 len: 1259 microversion: 2.1 time: 0.180706 Dec 15 13:37:03.621524 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 440/870] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:03 2021] GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e => generated 1259 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:04.546137 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-ae50fb0e-53b2-4271-8803-f1f35552a929 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:04.546760 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-ae50fb0e-53b2-4271-8803-f1f35552a929 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] [instance: 93bf7202-d763-46e8-a6ff-ff6b87ee9ad6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:04.552870 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ae50fb0e-53b2-4271-8803-f1f35552a929 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:04.553321 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ae50fb0e-53b2-4271-8803-f1f35552a929 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:04.554097 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ae50fb0e-53b2-4271-8803-f1f35552a929 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:04.554533 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ae50fb0e-53b2-4271-8803-f1f35552a929 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:04.637886 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-31e74cbd-350a-47b3-81d9-eb4dbf2003e4 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:04.638569 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-31e74cbd-350a-47b3-81d9-eb4dbf2003e4 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] [instance: b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:04.644925 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-31e74cbd-350a-47b3-81d9-eb4dbf2003e4 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:04.645374 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-31e74cbd-350a-47b3-81d9-eb4dbf2003e4 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:04.646158 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-31e74cbd-350a-47b3-81d9-eb4dbf2003e4 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:04.646593 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-31e74cbd-350a-47b3-81d9-eb4dbf2003e4 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:04.685168 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-ae50fb0e-53b2-4271-8803-f1f35552a929 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa1533801dc4fa0b79d8662414749d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8066a245289451b8a7cc12d4311b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:04.692818 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-ae50fb0e-53b2-4271-8803-f1f35552a929 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] 10.222.0.60 "GET /compute/v2.1/servers/93bf7202-d763-46e8-a6ff-ff6b87ee9ad6" status: 200 len: 1319 microversion: 2.1 time: 0.151124 Dec 15 13:37:04.693412 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 431/871] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:04 2021] GET /compute/v2.1/servers/93bf7202-d763-46e8-a6ff-ff6b87ee9ad6 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:04.784449 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-31e74cbd-350a-47b3-81d9-eb4dbf2003e4 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7774ea10bce345cabd96a0c94eda98b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ac6d4548e486492887beb2e915bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:04.791950 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-31e74cbd-350a-47b3-81d9-eb4dbf2003e4 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] 10.222.0.60 "GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e" status: 200 len: 1259 microversion: 2.1 time: 0.158262 Dec 15 13:37:04.792517 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 441/872] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:04 2021] GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:37:05.709596 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-63e79845-cd14-4a35-b835-4fd7797cc9b0 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:05.710207 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-63e79845-cd14-4a35-b835-4fd7797cc9b0 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] [instance: 93bf7202-d763-46e8-a6ff-ff6b87ee9ad6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:05.716948 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-63e79845-cd14-4a35-b835-4fd7797cc9b0 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:05.717393 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-63e79845-cd14-4a35-b835-4fd7797cc9b0 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:05.718177 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-63e79845-cd14-4a35-b835-4fd7797cc9b0 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:05.718607 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-63e79845-cd14-4a35-b835-4fd7797cc9b0 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:05.808443 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-50d3d192-91f2-4e23-93de-ad5902d13084 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:05.809057 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-50d3d192-91f2-4e23-93de-ad5902d13084 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] [instance: b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:05.815571 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-50d3d192-91f2-4e23-93de-ad5902d13084 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:05.816251 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-50d3d192-91f2-4e23-93de-ad5902d13084 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:05.817036 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-50d3d192-91f2-4e23-93de-ad5902d13084 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:05.817636 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-50d3d192-91f2-4e23-93de-ad5902d13084 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:05.853969 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-63e79845-cd14-4a35-b835-4fd7797cc9b0 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa1533801dc4fa0b79d8662414749d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8066a245289451b8a7cc12d4311b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:05.862056 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-63e79845-cd14-4a35-b835-4fd7797cc9b0 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] 10.222.0.60 "GET /compute/v2.1/servers/93bf7202-d763-46e8-a6ff-ff6b87ee9ad6" status: 200 len: 1319 microversion: 2.1 time: 0.156080 Dec 15 13:37:05.862730 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 432/873] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:05 2021] GET /compute/v2.1/servers/93bf7202-d763-46e8-a6ff-ff6b87ee9ad6 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:05.950928 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-50d3d192-91f2-4e23-93de-ad5902d13084 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7774ea10bce345cabd96a0c94eda98b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ac6d4548e486492887beb2e915bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:05.958177 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-50d3d192-91f2-4e23-93de-ad5902d13084 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] 10.222.0.60 "GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e" status: 200 len: 1259 microversion: 2.1 time: 0.153341 Dec 15 13:37:05.958746 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 442/874] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:05 2021] GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:37:06.878969 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-837a3008-6525-4cf2-8622-e003e873078b tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:06.879735 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-837a3008-6525-4cf2-8622-e003e873078b tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] [instance: 93bf7202-d763-46e8-a6ff-ff6b87ee9ad6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:06.886407 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-837a3008-6525-4cf2-8622-e003e873078b tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:06.886895 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-837a3008-6525-4cf2-8622-e003e873078b tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:06.887692 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-837a3008-6525-4cf2-8622-e003e873078b tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:06.888136 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-837a3008-6525-4cf2-8622-e003e873078b tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:06.975319 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-d18af1f8-bd55-432b-b6e0-38e59afd26c1 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:06.976003 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-d18af1f8-bd55-432b-b6e0-38e59afd26c1 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] [instance: b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:06.982341 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d18af1f8-bd55-432b-b6e0-38e59afd26c1 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:06.982806 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d18af1f8-bd55-432b-b6e0-38e59afd26c1 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:06.983647 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d18af1f8-bd55-432b-b6e0-38e59afd26c1 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:06.984945 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d18af1f8-bd55-432b-b6e0-38e59afd26c1 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:07.020953 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-837a3008-6525-4cf2-8622-e003e873078b tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa1533801dc4fa0b79d8662414749d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8066a245289451b8a7cc12d4311b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:07.028288 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-837a3008-6525-4cf2-8622-e003e873078b tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] 10.222.0.60 "GET /compute/v2.1/servers/93bf7202-d763-46e8-a6ff-ff6b87ee9ad6" status: 200 len: 1319 microversion: 2.1 time: 0.153044 Dec 15 13:37:07.029002 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 433/875] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:06 2021] GET /compute/v2.1/servers/93bf7202-d763-46e8-a6ff-ff6b87ee9ad6 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:07.116366 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-d18af1f8-bd55-432b-b6e0-38e59afd26c1 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7774ea10bce345cabd96a0c94eda98b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ac6d4548e486492887beb2e915bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:07.124113 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-d18af1f8-bd55-432b-b6e0-38e59afd26c1 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] 10.222.0.60 "GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e" status: 200 len: 1259 microversion: 2.1 time: 0.152441 Dec 15 13:37:07.124696 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 443/876] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:06 2021] GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:37:07.939468 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-08b55ed6-dc34-4a13-8f33-95f8faf689ee req-c0c25319-124d-49f2-856d-295bdc2bfb9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93bf7202-d763-46e8-a6ff-ff6b87ee9ad6", "name": "network-vif-plugged", "status": "completed", "tag": "fb1dabff-ae3a-4d15-a31e-f209b3bfbd0f"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:37:07.940990 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:37:07.940990 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: warnings.warn(msg) Dec 15 13:37:07.950322 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-08b55ed6-dc34-4a13-8f33-95f8faf689ee req-c0c25319-124d-49f2-856d-295bdc2bfb9a service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:07.950765 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-08b55ed6-dc34-4a13-8f33-95f8faf689ee req-c0c25319-124d-49f2-856d-295bdc2bfb9a service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:07.961220 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-08b55ed6-dc34-4a13-8f33-95f8faf689ee req-c0c25319-124d-49f2-856d-295bdc2bfb9a service nova] Creating event network-vif-plugged:fb1dabff-ae3a-4d15-a31e-f209b3bfbd0f for instance 93bf7202-d763-46e8-a6ff-ff6b87ee9ad6 on hv-cinder-81322 Dec 15 13:37:07.966692 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-08b55ed6-dc34-4a13-8f33-95f8faf689ee req-c0c25319-124d-49f2-856d-295bdc2bfb9a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086590 Dec 15 13:37:07.967516 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 434/877] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:37:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:37:08.044541 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-cdb97bce-c013-4c62-9fc4-1cd1e7085e32 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:08.045161 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-cdb97bce-c013-4c62-9fc4-1cd1e7085e32 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] [instance: 93bf7202-d763-46e8-a6ff-ff6b87ee9ad6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:08.051533 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-cdb97bce-c013-4c62-9fc4-1cd1e7085e32 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:08.052232 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-cdb97bce-c013-4c62-9fc4-1cd1e7085e32 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:08.053607 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-cdb97bce-c013-4c62-9fc4-1cd1e7085e32 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:08.054400 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-cdb97bce-c013-4c62-9fc4-1cd1e7085e32 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:08.142647 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-1a99a8ce-027f-4ca6-814c-c7bc98ed4b5e tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:08.144950 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-1a99a8ce-027f-4ca6-814c-c7bc98ed4b5e tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] [instance: b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:08.151960 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1a99a8ce-027f-4ca6-814c-c7bc98ed4b5e tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:08.152708 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1a99a8ce-027f-4ca6-814c-c7bc98ed4b5e tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:08.153517 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1a99a8ce-027f-4ca6-814c-c7bc98ed4b5e tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:08.154139 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1a99a8ce-027f-4ca6-814c-c7bc98ed4b5e tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:08.205037 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-cdb97bce-c013-4c62-9fc4-1cd1e7085e32 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa1533801dc4fa0b79d8662414749d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8066a245289451b8a7cc12d4311b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:08.212239 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-cdb97bce-c013-4c62-9fc4-1cd1e7085e32 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] 10.222.0.60 "GET /compute/v2.1/servers/93bf7202-d763-46e8-a6ff-ff6b87ee9ad6" status: 200 len: 1319 microversion: 2.1 time: 0.171489 Dec 15 13:37:08.212826 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 444/878] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:08 2021] GET /compute/v2.1/servers/93bf7202-d763-46e8-a6ff-ff6b87ee9ad6 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:08.296060 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-1a99a8ce-027f-4ca6-814c-c7bc98ed4b5e tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7774ea10bce345cabd96a0c94eda98b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ac6d4548e486492887beb2e915bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:08.303328 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-1a99a8ce-027f-4ca6-814c-c7bc98ed4b5e tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] 10.222.0.60 "GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e" status: 200 len: 1259 microversion: 2.1 time: 0.166343 Dec 15 13:37:08.303905 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 435/879] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:08 2021] GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:37:09.230086 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-40c71e32-8936-4553-b700-0242b56f1cb0 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:09.230716 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-40c71e32-8936-4553-b700-0242b56f1cb0 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] [instance: 93bf7202-d763-46e8-a6ff-ff6b87ee9ad6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:09.237416 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-40c71e32-8936-4553-b700-0242b56f1cb0 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:09.237881 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-40c71e32-8936-4553-b700-0242b56f1cb0 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:09.238667 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-40c71e32-8936-4553-b700-0242b56f1cb0 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:09.239127 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-40c71e32-8936-4553-b700-0242b56f1cb0 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:09.320305 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-c2373cf6-d67c-47f8-a082-51c777f2992b tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:09.320933 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-c2373cf6-d67c-47f8-a082-51c777f2992b tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] [instance: b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:09.328429 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c2373cf6-d67c-47f8-a082-51c777f2992b tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:09.328896 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c2373cf6-d67c-47f8-a082-51c777f2992b tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:09.329681 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c2373cf6-d67c-47f8-a082-51c777f2992b tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:09.330119 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c2373cf6-d67c-47f8-a082-51c777f2992b tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:09.379291 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-40c71e32-8936-4553-b700-0242b56f1cb0 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa1533801dc4fa0b79d8662414749d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8066a245289451b8a7cc12d4311b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:09.386448 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-40c71e32-8936-4553-b700-0242b56f1cb0 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] 10.222.0.60 "GET /compute/v2.1/servers/93bf7202-d763-46e8-a6ff-ff6b87ee9ad6" status: 200 len: 1319 microversion: 2.1 time: 0.161000 Dec 15 13:37:09.387603 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 445/880] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:09 2021] GET /compute/v2.1/servers/93bf7202-d763-46e8-a6ff-ff6b87ee9ad6 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:09.465625 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-c2373cf6-d67c-47f8-a082-51c777f2992b tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7774ea10bce345cabd96a0c94eda98b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ac6d4548e486492887beb2e915bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:09.472983 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-c2373cf6-d67c-47f8-a082-51c777f2992b tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] 10.222.0.60 "GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e" status: 200 len: 1259 microversion: 2.1 time: 0.156403 Dec 15 13:37:09.473553 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 436/881] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:09 2021] GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:37:09.983024 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-5a4594b6-465c-4e0d-b630-335cd4a91090 req-c5f7c122-3663-4927-8133-48612aa7748d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e", "name": "network-vif-plugged", "status": "completed", "tag": "271b8ee8-bedb-4be5-a4e3-37b1a376fe7f"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:37:09.984608 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:37:09.984608 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: warnings.warn(msg) Dec 15 13:37:09.991333 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-5a4594b6-465c-4e0d-b630-335cd4a91090 req-c5f7c122-3663-4927-8133-48612aa7748d service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:09.991777 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-5a4594b6-465c-4e0d-b630-335cd4a91090 req-c5f7c122-3663-4927-8133-48612aa7748d service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:10.003219 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-5a4594b6-465c-4e0d-b630-335cd4a91090 req-c5f7c122-3663-4927-8133-48612aa7748d service nova] Creating event network-vif-plugged:271b8ee8-bedb-4be5-a4e3-37b1a376fe7f for instance b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e on hv-cinder-81322 Dec 15 13:37:10.008205 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-5a4594b6-465c-4e0d-b630-335cd4a91090 req-c5f7c122-3663-4927-8133-48612aa7748d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029474 Dec 15 13:37:10.008928 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 446/882] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:37:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:37:10.404437 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-2235f111-c7cf-4c5f-b538-0ebad2bf6b00 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:10.405071 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-2235f111-c7cf-4c5f-b538-0ebad2bf6b00 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] [instance: 93bf7202-d763-46e8-a6ff-ff6b87ee9ad6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:10.411276 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2235f111-c7cf-4c5f-b538-0ebad2bf6b00 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:10.411730 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2235f111-c7cf-4c5f-b538-0ebad2bf6b00 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:10.412517 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2235f111-c7cf-4c5f-b538-0ebad2bf6b00 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:10.412951 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2235f111-c7cf-4c5f-b538-0ebad2bf6b00 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:10.490409 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-334a6062-22c4-48ce-ad3f-76bbdbfc6b8d tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:10.490796 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-334a6062-22c4-48ce-ad3f-76bbdbfc6b8d tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] [instance: b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:10.496819 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-334a6062-22c4-48ce-ad3f-76bbdbfc6b8d tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:10.497276 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-334a6062-22c4-48ce-ad3f-76bbdbfc6b8d tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:10.498104 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-334a6062-22c4-48ce-ad3f-76bbdbfc6b8d tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:10.498546 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-334a6062-22c4-48ce-ad3f-76bbdbfc6b8d tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:10.550422 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-2235f111-c7cf-4c5f-b538-0ebad2bf6b00 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa1533801dc4fa0b79d8662414749d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8066a245289451b8a7cc12d4311b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:10.558673 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-2235f111-c7cf-4c5f-b538-0ebad2bf6b00 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] 10.222.0.60 "GET /compute/v2.1/servers/93bf7202-d763-46e8-a6ff-ff6b87ee9ad6" status: 200 len: 1508 microversion: 2.1 time: 0.158336 Dec 15 13:37:10.559307 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 437/883] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:10 2021] GET /compute/v2.1/servers/93bf7202-d763-46e8-a6ff-ff6b87ee9ad6 => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:37:10.642326 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-334a6062-22c4-48ce-ad3f-76bbdbfc6b8d tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7774ea10bce345cabd96a0c94eda98b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ac6d4548e486492887beb2e915bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:10.649663 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-334a6062-22c4-48ce-ad3f-76bbdbfc6b8d tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] 10.222.0.60 "GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e" status: 200 len: 1259 microversion: 2.1 time: 0.164127 Dec 15 13:37:10.650252 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 447/884] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:10 2021] GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:37:11.665773 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-94b22f5c-c2e8-467c-b453-0f9787592b37 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:11.666373 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-94b22f5c-c2e8-467c-b453-0f9787592b37 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] [instance: b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:11.672661 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-94b22f5c-c2e8-467c-b453-0f9787592b37 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:11.673144 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-94b22f5c-c2e8-467c-b453-0f9787592b37 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:11.673909 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-94b22f5c-c2e8-467c-b453-0f9787592b37 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:11.674345 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-94b22f5c-c2e8-467c-b453-0f9787592b37 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:11.804541 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-94b22f5c-c2e8-467c-b453-0f9787592b37 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7774ea10bce345cabd96a0c94eda98b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ac6d4548e486492887beb2e915bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:11.812293 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-94b22f5c-c2e8-467c-b453-0f9787592b37 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] 10.222.0.60 "GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e" status: 200 len: 1259 microversion: 2.1 time: 0.150153 Dec 15 13:37:11.812868 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 438/885] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:11 2021] GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:12.829570 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-edf69d70-9876-4aec-9bb9-4cdfbca1d44f tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:12.830176 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-edf69d70-9876-4aec-9bb9-4cdfbca1d44f tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] [instance: b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:12.836488 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-edf69d70-9876-4aec-9bb9-4cdfbca1d44f tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:12.836947 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-edf69d70-9876-4aec-9bb9-4cdfbca1d44f tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:12.837730 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-edf69d70-9876-4aec-9bb9-4cdfbca1d44f tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:12.838173 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-edf69d70-9876-4aec-9bb9-4cdfbca1d44f tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:12.971836 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-edf69d70-9876-4aec-9bb9-4cdfbca1d44f tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7774ea10bce345cabd96a0c94eda98b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ac6d4548e486492887beb2e915bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:12.979384 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-edf69d70-9876-4aec-9bb9-4cdfbca1d44f tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] 10.222.0.60 "GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e" status: 200 len: 1442 microversion: 2.1 time: 0.153575 Dec 15 13:37:12.979964 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 448/886] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:12 2021] GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e => generated 1442 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:12.995053 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-0b52cd89-8bef-4aaf-a51f-c83bdb495787 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:12.995663 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-0b52cd89-8bef-4aaf-a51f-c83bdb495787 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] [instance: b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:13.002235 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0b52cd89-8bef-4aaf-a51f-c83bdb495787 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:13.002678 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0b52cd89-8bef-4aaf-a51f-c83bdb495787 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:13.003519 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0b52cd89-8bef-4aaf-a51f-c83bdb495787 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:13.003950 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0b52cd89-8bef-4aaf-a51f-c83bdb495787 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:13.136759 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-0b52cd89-8bef-4aaf-a51f-c83bdb495787 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7774ea10bce345cabd96a0c94eda98b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ac6d4548e486492887beb2e915bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:13.144851 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-0b52cd89-8bef-4aaf-a51f-c83bdb495787 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] 10.222.0.60 "GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e" status: 200 len: 1442 microversion: 2.1 time: 0.153508 Dec 15 13:37:13.145433 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 439/887] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:12 2021] GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e => generated 1442 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:14.933910 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-3e69b70c-f494-4b30-865b-f545439bd6a7 req-545f19d0-1723-4418-935d-7d7008df62c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e", "tag": "271b8ee8-bedb-4be5-a4e3-37b1a376fe7f"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:37:14.935489 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:37:14.935489 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: warnings.warn(msg) Dec 15 13:37:14.942353 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-3e69b70c-f494-4b30-865b-f545439bd6a7 req-545f19d0-1723-4418-935d-7d7008df62c5 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:14.942737 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-3e69b70c-f494-4b30-865b-f545439bd6a7 req-545f19d0-1723-4418-935d-7d7008df62c5 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:14.954336 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-3e69b70c-f494-4b30-865b-f545439bd6a7 req-545f19d0-1723-4418-935d-7d7008df62c5 service nova] Creating event network-changed:271b8ee8-bedb-4be5-a4e3-37b1a376fe7f for instance b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e on hv-cinder-81322 Dec 15 13:37:14.959391 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-3e69b70c-f494-4b30-865b-f545439bd6a7 req-545f19d0-1723-4418-935d-7d7008df62c5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089418 Dec 15 13:37:14.959998 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 449/888] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:37:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:37:19.048988 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-df2f39c7-465d-4cac-850d-727584e53635 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:19.049488 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-df2f39c7-465d-4cac-850d-727584e53635 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:19.055355 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-df2f39c7-465d-4cac-850d-727584e53635 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:19.055868 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-df2f39c7-465d-4cac-850d-727584e53635 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:19.056841 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-df2f39c7-465d-4cac-850d-727584e53635 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:19.057286 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-df2f39c7-465d-4cac-850d-727584e53635 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:19.135518 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.objects.instance [None req-df2f39c7-465d-4cac-850d-727584e53635 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lazy-loading 'services' on Instance uuid ef0157ed-5d02-45a9-9160-55cc033a16ec {{(pid=116941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:37:19.205298 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-df2f39c7-465d-4cac-850d-727584e53635 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/os-volume_attachments/8825dbd9-17d8-4825-9b4e-5f1b7f6b9b66" status: 202 len: 0 microversion: 2.1 time: 0.260470 Dec 15 13:37:19.205833 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 440/889] 10.222.0.60 () {58 vars in 1415 bytes} [Wed Dec 15 13:37:18 2021] DELETE /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/os-volume_attachments/8825dbd9-17d8-4825-9b4e-5f1b7f6b9b66 => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:37:20.317320 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-2a0858e9-75a8-4a1c-8483-dbe003b020f1 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:37:20.323742 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2a0858e9-75a8-4a1c-8483-dbe003b020f1 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:20.324196 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2a0858e9-75a8-4a1c-8483-dbe003b020f1 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:20.345208 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-2a0858e9-75a8-4a1c-8483-dbe003b020f1 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Going to try to stop instance {{(pid=116942) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 15 13:37:20.387895 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-2a0858e9-75a8-4a1c-8483-dbe003b020f1 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 202 len: 0 microversion: 2.1 time: 0.074829 Dec 15 13:37:20.388491 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 450/890] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:37:20 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:37:20.397387 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-1bec9b7a-b6d9-4e26-8f07-a7b6268dbeb3 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:20.398096 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-1bec9b7a-b6d9-4e26-8f07-a7b6268dbeb3 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:20.404864 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1bec9b7a-b6d9-4e26-8f07-a7b6268dbeb3 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:20.405335 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1bec9b7a-b6d9-4e26-8f07-a7b6268dbeb3 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:20.406128 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1bec9b7a-b6d9-4e26-8f07-a7b6268dbeb3 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:20.406569 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1bec9b7a-b6d9-4e26-8f07-a7b6268dbeb3 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:20.560467 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-1bec9b7a-b6d9-4e26-8f07-a7b6268dbeb3 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:20.567926 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-1bec9b7a-b6d9-4e26-8f07-a7b6268dbeb3 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1678 microversion: 2.1 time: 0.174936 Dec 15 13:37:20.568503 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 441/891] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:20 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1678 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:21.587047 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-e11d921f-07e0-41da-8766-be768f9f796e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:21.587819 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-e11d921f-07e0-41da-8766-be768f9f796e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:21.594279 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e11d921f-07e0-41da-8766-be768f9f796e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:21.594793 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e11d921f-07e0-41da-8766-be768f9f796e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:21.595611 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e11d921f-07e0-41da-8766-be768f9f796e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:21.596053 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e11d921f-07e0-41da-8766-be768f9f796e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:21.726988 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-e11d921f-07e0-41da-8766-be768f9f796e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:21.734959 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-e11d921f-07e0-41da-8766-be768f9f796e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1678 microversion: 2.1 time: 0.152437 Dec 15 13:37:21.735534 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 451/892] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:21 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:22.752407 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-ecac454c-2590-4944-9070-02db860f31c8 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:22.752946 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-ecac454c-2590-4944-9070-02db860f31c8 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:22.759446 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ecac454c-2590-4944-9070-02db860f31c8 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:22.759890 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ecac454c-2590-4944-9070-02db860f31c8 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:22.760677 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ecac454c-2590-4944-9070-02db860f31c8 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:22.761111 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ecac454c-2590-4944-9070-02db860f31c8 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:22.899344 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-ecac454c-2590-4944-9070-02db860f31c8 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:22.906480 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-ecac454c-2590-4944-9070-02db860f31c8 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1678 microversion: 2.1 time: 0.157788 Dec 15 13:37:22.907101 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 442/893] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:22 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:23.923697 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-3102fe9d-9077-447b-86fe-41f575cd5ec1 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:23.924236 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-3102fe9d-9077-447b-86fe-41f575cd5ec1 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:23.930418 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3102fe9d-9077-447b-86fe-41f575cd5ec1 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:23.930894 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3102fe9d-9077-447b-86fe-41f575cd5ec1 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:23.931679 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3102fe9d-9077-447b-86fe-41f575cd5ec1 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:23.932117 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3102fe9d-9077-447b-86fe-41f575cd5ec1 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:24.060419 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-3102fe9d-9077-447b-86fe-41f575cd5ec1 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:24.067755 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-3102fe9d-9077-447b-86fe-41f575cd5ec1 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1678 microversion: 2.1 time: 0.147771 Dec 15 13:37:24.068334 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 452/894] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:23 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:25.084783 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-3f8174cb-bfe1-4548-bc5e-ace3cd754c47 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:25.085400 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-3f8174cb-bfe1-4548-bc5e-ace3cd754c47 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:25.092318 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3f8174cb-bfe1-4548-bc5e-ace3cd754c47 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:25.092779 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3f8174cb-bfe1-4548-bc5e-ace3cd754c47 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:25.093569 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3f8174cb-bfe1-4548-bc5e-ace3cd754c47 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:25.094013 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3f8174cb-bfe1-4548-bc5e-ace3cd754c47 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:25.228297 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-3f8174cb-bfe1-4548-bc5e-ace3cd754c47 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:25.236235 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-3f8174cb-bfe1-4548-bc5e-ace3cd754c47 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1678 microversion: 2.1 time: 0.155180 Dec 15 13:37:25.236808 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 443/895] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:25 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:26.254133 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-869541a6-6fd2-44e6-a5f4-4d42823dbea0 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:26.254741 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-869541a6-6fd2-44e6-a5f4-4d42823dbea0 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:26.261058 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-869541a6-6fd2-44e6-a5f4-4d42823dbea0 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:26.261597 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-869541a6-6fd2-44e6-a5f4-4d42823dbea0 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:26.262464 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-869541a6-6fd2-44e6-a5f4-4d42823dbea0 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:26.262935 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-869541a6-6fd2-44e6-a5f4-4d42823dbea0 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:26.397096 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-869541a6-6fd2-44e6-a5f4-4d42823dbea0 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:26.404257 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-869541a6-6fd2-44e6-a5f4-4d42823dbea0 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1678 microversion: 2.1 time: 0.153810 Dec 15 13:37:26.404838 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 453/896] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:26 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:27.421020 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-389c5748-0d0d-45dc-b964-aea4d0cf0ec3 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:27.421635 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-389c5748-0d0d-45dc-b964-aea4d0cf0ec3 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:27.427876 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-389c5748-0d0d-45dc-b964-aea4d0cf0ec3 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:27.428344 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-389c5748-0d0d-45dc-b964-aea4d0cf0ec3 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:27.429101 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-389c5748-0d0d-45dc-b964-aea4d0cf0ec3 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:27.429535 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-389c5748-0d0d-45dc-b964-aea4d0cf0ec3 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:27.557773 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-389c5748-0d0d-45dc-b964-aea4d0cf0ec3 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:27.565580 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-389c5748-0d0d-45dc-b964-aea4d0cf0ec3 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1678 microversion: 2.1 time: 0.148270 Dec 15 13:37:27.566151 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 444/897] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:27 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:28.582563 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-63aace27-439d-437f-82fc-3189fbaffa9b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:28.583152 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-63aace27-439d-437f-82fc-3189fbaffa9b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:28.589364 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-63aace27-439d-437f-82fc-3189fbaffa9b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:28.589819 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-63aace27-439d-437f-82fc-3189fbaffa9b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:28.590643 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-63aace27-439d-437f-82fc-3189fbaffa9b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:28.591116 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-63aace27-439d-437f-82fc-3189fbaffa9b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:28.720454 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-63aace27-439d-437f-82fc-3189fbaffa9b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:28.727709 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-63aace27-439d-437f-82fc-3189fbaffa9b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1678 microversion: 2.1 time: 0.148905 Dec 15 13:37:28.728580 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 454/898] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:28 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:29.744301 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-9c16388f-45cb-483e-901b-63b2debe97b8 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:29.744919 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-9c16388f-45cb-483e-901b-63b2debe97b8 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:29.751175 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9c16388f-45cb-483e-901b-63b2debe97b8 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:29.751632 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9c16388f-45cb-483e-901b-63b2debe97b8 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:29.752417 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9c16388f-45cb-483e-901b-63b2debe97b8 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:29.752860 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9c16388f-45cb-483e-901b-63b2debe97b8 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:29.879655 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-9c16388f-45cb-483e-901b-63b2debe97b8 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:29.886792 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-9c16388f-45cb-483e-901b-63b2debe97b8 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1678 microversion: 2.1 time: 0.146150 Dec 15 13:37:29.887895 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 445/899] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:29 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1678 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:30.903062 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-2564c245-4f4a-4a37-8edc-b7d2744a1c0d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:30.903672 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-2564c245-4f4a-4a37-8edc-b7d2744a1c0d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:30.909801 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2564c245-4f4a-4a37-8edc-b7d2744a1c0d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:30.910253 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2564c245-4f4a-4a37-8edc-b7d2744a1c0d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:30.911076 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2564c245-4f4a-4a37-8edc-b7d2744a1c0d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:30.911513 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2564c245-4f4a-4a37-8edc-b7d2744a1c0d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:31.041647 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-2564c245-4f4a-4a37-8edc-b7d2744a1c0d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:31.050502 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-2564c245-4f4a-4a37-8edc-b7d2744a1c0d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1678 microversion: 2.1 time: 0.151008 Dec 15 13:37:31.051102 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 455/900] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:30 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:32.067232 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-d4e32cbb-8455-4896-8fea-610d963f560d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:32.067886 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-d4e32cbb-8455-4896-8fea-610d963f560d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:32.074477 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d4e32cbb-8455-4896-8fea-610d963f560d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:32.074979 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d4e32cbb-8455-4896-8fea-610d963f560d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:32.075772 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d4e32cbb-8455-4896-8fea-610d963f560d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:32.076219 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d4e32cbb-8455-4896-8fea-610d963f560d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:32.207170 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-d4e32cbb-8455-4896-8fea-610d963f560d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:32.214484 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-d4e32cbb-8455-4896-8fea-610d963f560d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1678 microversion: 2.1 time: 0.150956 Dec 15 13:37:32.215094 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 446/901] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:32 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:33.231283 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-92b71770-18eb-476d-a388-484727f89cb8 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:33.231930 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-92b71770-18eb-476d-a388-484727f89cb8 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:33.238209 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-92b71770-18eb-476d-a388-484727f89cb8 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:33.238665 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-92b71770-18eb-476d-a388-484727f89cb8 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:33.239480 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-92b71770-18eb-476d-a388-484727f89cb8 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:33.239948 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-92b71770-18eb-476d-a388-484727f89cb8 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:33.364237 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-92b71770-18eb-476d-a388-484727f89cb8 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:33.371502 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-92b71770-18eb-476d-a388-484727f89cb8 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1678 microversion: 2.1 time: 0.143848 Dec 15 13:37:33.372572 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 456/902] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:33 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1678 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:34.389416 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-50b0aab6-3c67-4b12-8f64-2f01ab4a91f1 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:34.389947 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-50b0aab6-3c67-4b12-8f64-2f01ab4a91f1 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:34.396278 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-50b0aab6-3c67-4b12-8f64-2f01ab4a91f1 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:34.396738 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-50b0aab6-3c67-4b12-8f64-2f01ab4a91f1 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:34.397534 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-50b0aab6-3c67-4b12-8f64-2f01ab4a91f1 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:34.397980 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-50b0aab6-3c67-4b12-8f64-2f01ab4a91f1 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:34.534346 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-50b0aab6-3c67-4b12-8f64-2f01ab4a91f1 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:34.541663 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-50b0aab6-3c67-4b12-8f64-2f01ab4a91f1 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1678 microversion: 2.1 time: 0.156528 Dec 15 13:37:34.542243 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 447/903] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:34 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:35.558184 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-4c815dd5-8149-47eb-8ee1-b35741450eaa tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:35.558795 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-4c815dd5-8149-47eb-8ee1-b35741450eaa tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:35.565615 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4c815dd5-8149-47eb-8ee1-b35741450eaa tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:35.566065 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4c815dd5-8149-47eb-8ee1-b35741450eaa tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:35.566865 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4c815dd5-8149-47eb-8ee1-b35741450eaa tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:35.567299 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4c815dd5-8149-47eb-8ee1-b35741450eaa tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:35.698542 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-4c815dd5-8149-47eb-8ee1-b35741450eaa tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:35.706678 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-4c815dd5-8149-47eb-8ee1-b35741450eaa tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1678 microversion: 2.1 time: 0.151982 Dec 15 13:37:35.707296 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 457/904] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:35 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:36.099546 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-ba366616-0929-44bd-adda-02d39d48f943 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "66032f01-2617-4670-9c1c-ba0ba5cbb322", "device": "/dev/sdb"}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:37:36.101153 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-ba366616-0929-44bd-adda-02d39d48f943 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] [instance: 93bf7202-d763-46e8-a6ff-ff6b87ee9ad6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:36.108009 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ba366616-0929-44bd-adda-02d39d48f943 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:36.108459 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ba366616-0929-44bd-adda-02d39d48f943 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:36.109237 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ba366616-0929-44bd-adda-02d39d48f943 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:36.109673 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ba366616-0929-44bd-adda-02d39d48f943 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:36.342430 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-ba366616-0929-44bd-adda-02d39d48f943 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] 10.222.0.60 "POST /compute/v2.1/servers/93bf7202-d763-46e8-a6ff-ff6b87ee9ad6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.246441 Dec 15 13:37:36.345997 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 448/905] 10.222.0.60 () {60 vars in 1322 bytes} [Wed Dec 15 13:37:36 2021] POST /compute/v2.1/servers/93bf7202-d763-46e8-a6ff-ff6b87ee9ad6/os-volume_attachments => generated 194 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:37:36.723449 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ce98af54-9adc-43bb-868d-4e36fb6edcde tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:36.724064 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ce98af54-9adc-43bb-868d-4e36fb6edcde tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:36.730246 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ce98af54-9adc-43bb-868d-4e36fb6edcde tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:36.730708 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ce98af54-9adc-43bb-868d-4e36fb6edcde tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:36.731545 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ce98af54-9adc-43bb-868d-4e36fb6edcde tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:36.731990 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ce98af54-9adc-43bb-868d-4e36fb6edcde tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:37.056324 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-ce98af54-9adc-43bb-868d-4e36fb6edcde tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:37.063488 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ce98af54-9adc-43bb-868d-4e36fb6edcde tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1655 microversion: 2.1 time: 0.343760 Dec 15 13:37:37.064079 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 458/906] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:36 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1655 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:37.080669 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-417593b3-5b32-4180-8b94-ce7acc5ab059 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:37:37.086803 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-417593b3-5b32-4180-8b94-ce7acc5ab059 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:37.087288 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-417593b3-5b32-4180-8b94-ce7acc5ab059 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:37.109315 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-417593b3-5b32-4180-8b94-ce7acc5ab059 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Going to try to start instance {{(pid=116941) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 15 13:37:37.146919 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-417593b3-5b32-4180-8b94-ce7acc5ab059 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action" status: 202 len: 0 microversion: 2.1 time: 0.070487 Dec 15 13:37:37.147460 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 449/907] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:37:37 2021] POST /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/action => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:37:37.155665 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-b80b71c9-90ca-4176-88cf-7c4bac66eb42 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:37.156295 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-b80b71c9-90ca-4176-88cf-7c4bac66eb42 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:37.161946 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b80b71c9-90ca-4176-88cf-7c4bac66eb42 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:37.162452 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b80b71c9-90ca-4176-88cf-7c4bac66eb42 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:37.163388 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b80b71c9-90ca-4176-88cf-7c4bac66eb42 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:37.163964 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b80b71c9-90ca-4176-88cf-7c4bac66eb42 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:37.293458 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-b80b71c9-90ca-4176-88cf-7c4bac66eb42 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:37.301605 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-b80b71c9-90ca-4176-88cf-7c4bac66eb42 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1664 microversion: 2.1 time: 0.150020 Dec 15 13:37:37.302285 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 459/908] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:37 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1664 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:38.319687 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-c16e33b0-fea5-4e1b-8a05-913dbbe715c6 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:38.320396 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-c16e33b0-fea5-4e1b-8a05-913dbbe715c6 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:38.326615 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c16e33b0-fea5-4e1b-8a05-913dbbe715c6 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:38.327104 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c16e33b0-fea5-4e1b-8a05-913dbbe715c6 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:38.327892 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c16e33b0-fea5-4e1b-8a05-913dbbe715c6 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:38.328333 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c16e33b0-fea5-4e1b-8a05-913dbbe715c6 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:38.470595 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-c16e33b0-fea5-4e1b-8a05-913dbbe715c6 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:38.476071 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-c16e33b0-fea5-4e1b-8a05-913dbbe715c6 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1664 microversion: 2.1 time: 0.160828 Dec 15 13:37:38.476667 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 450/909] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:38 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1664 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:39.494175 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-06a6f476-5de7-4b8c-8fd4-81003176debc tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:39.494782 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-06a6f476-5de7-4b8c-8fd4-81003176debc tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:39.501848 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-06a6f476-5de7-4b8c-8fd4-81003176debc tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:39.502297 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-06a6f476-5de7-4b8c-8fd4-81003176debc tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:39.503132 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-06a6f476-5de7-4b8c-8fd4-81003176debc tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:39.503567 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-06a6f476-5de7-4b8c-8fd4-81003176debc tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:39.630773 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-06a6f476-5de7-4b8c-8fd4-81003176debc tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:39.637978 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-06a6f476-5de7-4b8c-8fd4-81003176debc tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1668 microversion: 2.1 time: 0.147424 Dec 15 13:37:39.638559 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 460/910] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:39 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1668 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:41.692708 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:37:41.693217 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: Wed Dec 15 13:37:41 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 13:37:43.216371 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-4c3b5bcf-1b91-47d6-b3bd-703eb9499465 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1625398936"}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:37:43.216919 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-4c3b5bcf-1b91-47d6-b3bd-703eb9499465 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:43.222749 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4c3b5bcf-1b91-47d6-b3bd-703eb9499465 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:43.223242 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4c3b5bcf-1b91-47d6-b3bd-703eb9499465 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:43.224031 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4c3b5bcf-1b91-47d6-b3bd-703eb9499465 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:43.224472 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4c3b5bcf-1b91-47d6-b3bd-703eb9499465 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:43.347730 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.network.security_group_api [None req-4c3b5bcf-1b91-47d6-b3bd-703eb9499465 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Removing security group 38c7b061-13d4-4935-b838-e335d76ae1b9 from port f90cb0df-c11c-44a8-b09b-274188bbac57 Dec 15 13:37:43.686050 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-b8b543f5-8dbc-4d4c-9a72-0adde6caf8eb req-40a420e8-8d15-4a37-92ef-51a8657412d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f21e20b-c80e-408b-849e-cf9e27127cbb", "tag": "f90cb0df-c11c-44a8-b09b-274188bbac57"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:37:43.691285 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-4c3b5bcf-1b91-47d6-b3bd-703eb9499465 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "POST /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb/action" status: 202 len: 0 microversion: 2.1 time: 0.561181 Dec 15 13:37:43.692111 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 451/911] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:37:43 2021] POST /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb/action => generated 0 bytes in 575 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:37:43.694340 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:37:43.694340 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: warnings.warn(msg) Dec 15 13:37:43.703312 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-b8b543f5-8dbc-4d4c-9a72-0adde6caf8eb req-40a420e8-8d15-4a37-92ef-51a8657412d3 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:43.703773 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-b8b543f5-8dbc-4d4c-9a72-0adde6caf8eb req-40a420e8-8d15-4a37-92ef-51a8657412d3 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:43.717773 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-b8b543f5-8dbc-4d4c-9a72-0adde6caf8eb req-40a420e8-8d15-4a37-92ef-51a8657412d3 service nova] Creating event network-changed:f90cb0df-c11c-44a8-b09b-274188bbac57 for instance 9f21e20b-c80e-408b-849e-cf9e27127cbb on hv-cinder-81322 Dec 15 13:37:43.724593 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-b8b543f5-8dbc-4d4c-9a72-0adde6caf8eb req-40a420e8-8d15-4a37-92ef-51a8657412d3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042644 Dec 15 13:37:43.725711 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 461/912] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:37:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:37:44.974475 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-74b3f840-7d91-4af8-95ba-bd8630dcebeb tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:44.975003 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-74b3f840-7d91-4af8-95ba-bd8630dcebeb tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:44.980864 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-74b3f840-7d91-4af8-95ba-bd8630dcebeb tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:44.981832 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-74b3f840-7d91-4af8-95ba-bd8630dcebeb tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:44.982618 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-74b3f840-7d91-4af8-95ba-bd8630dcebeb tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:44.983082 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-74b3f840-7d91-4af8-95ba-bd8630dcebeb tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:45.060570 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.objects.instance [None req-74b3f840-7d91-4af8-95ba-bd8630dcebeb tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lazy-loading 'services' on Instance uuid 9f21e20b-c80e-408b-849e-cf9e27127cbb {{(pid=116941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:37:45.130634 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-74b3f840-7d91-4af8-95ba-bd8630dcebeb tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb/os-volume_attachments/8a8040c5-544f-452c-ab69-8e1f5d846e40" status: 202 len: 0 microversion: 2.1 time: 0.160151 Dec 15 13:37:45.131281 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 452/913] 10.222.0.60 () {58 vars in 1415 bytes} [Wed Dec 15 13:37:44 2021] DELETE /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb/os-volume_attachments/8a8040c5-544f-452c-ab69-8e1f5d846e40 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:37:45.141361 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-da961e61-7f75-489f-9811-4e64f1b518ad tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:45.142366 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-da961e61-7f75-489f-9811-4e64f1b518ad tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:45.149472 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-da961e61-7f75-489f-9811-4e64f1b518ad tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:45.149955 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-da961e61-7f75-489f-9811-4e64f1b518ad tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:45.151824 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-da961e61-7f75-489f-9811-4e64f1b518ad tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:45.152272 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-da961e61-7f75-489f-9811-4e64f1b518ad tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:45.183286 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-da961e61-7f75-489f-9811-4e64f1b518ad tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046555 Dec 15 13:37:45.183864 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 462/914] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Dec 15 13:37:45 2021] GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:37:45.742774 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-54f9f435-4c9f-4acf-8c17-b73055bfc5c5 req-c69e1940-e1a8-413d-81b6-81cc608197f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f21e20b-c80e-408b-849e-cf9e27127cbb", "tag": "f90cb0df-c11c-44a8-b09b-274188bbac57"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:37:45.744355 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:37:45.744355 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: warnings.warn(msg) Dec 15 13:37:45.752186 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-54f9f435-4c9f-4acf-8c17-b73055bfc5c5 req-c69e1940-e1a8-413d-81b6-81cc608197f8 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:45.752639 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-54f9f435-4c9f-4acf-8c17-b73055bfc5c5 req-c69e1940-e1a8-413d-81b6-81cc608197f8 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:45.916861 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-54f9f435-4c9f-4acf-8c17-b73055bfc5c5 req-c69e1940-e1a8-413d-81b6-81cc608197f8 service nova] Creating event network-changed:f90cb0df-c11c-44a8-b09b-274188bbac57 for instance 9f21e20b-c80e-408b-849e-cf9e27127cbb on hv-cinder-81322 Dec 15 13:37:45.922798 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-54f9f435-4c9f-4acf-8c17-b73055bfc5c5 req-c69e1940-e1a8-413d-81b6-81cc608197f8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.184020 Dec 15 13:37:45.923438 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 453/915] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:37:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:37:46.195610 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-19fd2f6c-991d-4b31-9bf1-2eb9b0a8341f tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:46.196465 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-19fd2f6c-991d-4b31-9bf1-2eb9b0a8341f tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:46.202970 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-19fd2f6c-991d-4b31-9bf1-2eb9b0a8341f tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:46.203429 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-19fd2f6c-991d-4b31-9bf1-2eb9b0a8341f tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:46.204215 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-19fd2f6c-991d-4b31-9bf1-2eb9b0a8341f tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:46.204660 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-19fd2f6c-991d-4b31-9bf1-2eb9b0a8341f tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:46.233394 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-19fd2f6c-991d-4b31-9bf1-2eb9b0a8341f tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041682 Dec 15 13:37:46.233941 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 463/916] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Dec 15 13:37:46 2021] GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:37:47.245280 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-735539f5-4842-480d-9eb9-009f42d466c5 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:47.246257 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-735539f5-4842-480d-9eb9-009f42d466c5 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:47.252866 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-735539f5-4842-480d-9eb9-009f42d466c5 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:47.253309 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-735539f5-4842-480d-9eb9-009f42d466c5 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:47.254075 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-735539f5-4842-480d-9eb9-009f42d466c5 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:47.254521 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-735539f5-4842-480d-9eb9-009f42d466c5 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:47.281494 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-735539f5-4842-480d-9eb9-009f42d466c5 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040850 Dec 15 13:37:47.282022 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 454/917] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Dec 15 13:37:47 2021] GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:37:48.293061 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-31918c1c-089f-48ba-9fbd-f0def07aaee4 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:48.295282 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-31918c1c-089f-48ba-9fbd-f0def07aaee4 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:48.303383 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-31918c1c-089f-48ba-9fbd-f0def07aaee4 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:48.303835 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-31918c1c-089f-48ba-9fbd-f0def07aaee4 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:48.304626 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-31918c1c-089f-48ba-9fbd-f0def07aaee4 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:48.305067 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-31918c1c-089f-48ba-9fbd-f0def07aaee4 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:48.334109 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-31918c1c-089f-48ba-9fbd-f0def07aaee4 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045039 Dec 15 13:37:48.334665 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 464/918] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Dec 15 13:37:48 2021] GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:37:49.346219 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-52f77465-c6b8-4ed9-80f9-41c44db90b5f tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:49.347181 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-52f77465-c6b8-4ed9-80f9-41c44db90b5f tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:49.353850 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-52f77465-c6b8-4ed9-80f9-41c44db90b5f tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:49.354304 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-52f77465-c6b8-4ed9-80f9-41c44db90b5f tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:49.355120 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-52f77465-c6b8-4ed9-80f9-41c44db90b5f tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:49.355562 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-52f77465-c6b8-4ed9-80f9-41c44db90b5f tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:49.384521 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-52f77465-c6b8-4ed9-80f9-41c44db90b5f tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041951 Dec 15 13:37:49.385009 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 455/919] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Dec 15 13:37:49 2021] GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:37:50.397081 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-71fbc26b-1076-4296-a26d-179d33dd650b tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:50.397992 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-71fbc26b-1076-4296-a26d-179d33dd650b tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:50.404188 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-71fbc26b-1076-4296-a26d-179d33dd650b tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:50.404646 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-71fbc26b-1076-4296-a26d-179d33dd650b tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:50.405432 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-71fbc26b-1076-4296-a26d-179d33dd650b tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:50.405877 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-71fbc26b-1076-4296-a26d-179d33dd650b tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:50.433957 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-71fbc26b-1076-4296-a26d-179d33dd650b tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040585 Dec 15 13:37:50.435175 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 465/920] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Dec 15 13:37:50 2021] GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:37:50.444941 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-c7d6b51d-aad5-4e84-9ae2-d75cb86b2740 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:50.445443 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-c7d6b51d-aad5-4e84-9ae2-d75cb86b2740 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:50.453814 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c7d6b51d-aad5-4e84-9ae2-d75cb86b2740 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:50.454264 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c7d6b51d-aad5-4e84-9ae2-d75cb86b2740 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:50.455093 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c7d6b51d-aad5-4e84-9ae2-d75cb86b2740 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:50.455529 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c7d6b51d-aad5-4e84-9ae2-d75cb86b2740 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:50.525076 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.wsgi [None req-c7d6b51d-aad5-4e84-9ae2-d75cb86b2740 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] HTTP exception thrown: Instance 9f21e20b-c80e-408b-849e-cf9e27127cbb is not attached to volume 8a8040c5-544f-452c-ab69-8e1f5d846e40 Dec 15 13:37:50.525675 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-c7d6b51d-aad5-4e84-9ae2-d75cb86b2740 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Returning 404 to user: Instance 9f21e20b-c80e-408b-849e-cf9e27127cbb is not attached to volume 8a8040c5-544f-452c-ab69-8e1f5d846e40 {{(pid=116941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:37:50.526492 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-c7d6b51d-aad5-4e84-9ae2-d75cb86b2740 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb/os-volume_attachments/8a8040c5-544f-452c-ab69-8e1f5d846e40" status: 404 len: 154 microversion: 2.1 time: 0.085544 Dec 15 13:37:50.527061 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 456/921] 10.222.0.60 () {58 vars in 1415 bytes} [Wed Dec 15 13:37:50 2021] DELETE /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb/os-volume_attachments/8a8040c5-544f-452c-ab69-8e1f5d846e40 => generated 154 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:37:55.830372 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-7f2305a1-b5e3-45a4-a570-54a4e5b3ae1c tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:55.830903 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-7f2305a1-b5e3-45a4-a570-54a4e5b3ae1c tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:55.837023 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7f2305a1-b5e3-45a4-a570-54a4e5b3ae1c tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:55.837475 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7f2305a1-b5e3-45a4-a570-54a4e5b3ae1c tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:55.838246 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7f2305a1-b5e3-45a4-a570-54a4e5b3ae1c tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:55.838682 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7f2305a1-b5e3-45a4-a570-54a4e5b3ae1c tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:55.861959 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-7f2305a1-b5e3-45a4-a570-54a4e5b3ae1c tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Going to try to terminate instance {{(pid=116942) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:37:55.931648 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-7f2305a1-b5e3-45a4-a570-54a4e5b3ae1c tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb" status: 204 len: 0 microversion: 2.1 time: 0.104589 Dec 15 13:37:55.932246 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 466/922] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Dec 15 13:37:55 2021] DELETE /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 15 13:37:55.940816 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-356b5621-a40a-4b9f-92fc-f44fc861a1cd tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:55.941438 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-356b5621-a40a-4b9f-92fc-f44fc861a1cd tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:55.947913 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-356b5621-a40a-4b9f-92fc-f44fc861a1cd tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:55.948362 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-356b5621-a40a-4b9f-92fc-f44fc861a1cd tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:55.949143 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-356b5621-a40a-4b9f-92fc-f44fc861a1cd tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:55.949576 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-356b5621-a40a-4b9f-92fc-f44fc861a1cd tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:56.078035 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-356b5621-a40a-4b9f-92fc-f44fc861a1cd tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed1331bcb0e4fe4a53379d1d72f650a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38faa56e5864d3aba51e1e8351e3a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:56.086395 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-356b5621-a40a-4b9f-92fc-f44fc861a1cd tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb" status: 200 len: 1553 microversion: 2.1 time: 0.149312 Dec 15 13:37:56.087122 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 457/923] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:55 2021] GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:57.103982 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-6f863ec8-af32-4240-bf43-79accdd09d3f tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:57.104683 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-6f863ec8-af32-4240-bf43-79accdd09d3f tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:57.111356 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6f863ec8-af32-4240-bf43-79accdd09d3f tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:57.111808 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6f863ec8-af32-4240-bf43-79accdd09d3f tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:57.112594 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6f863ec8-af32-4240-bf43-79accdd09d3f tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:57.113036 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6f863ec8-af32-4240-bf43-79accdd09d3f tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:57.243839 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-6f863ec8-af32-4240-bf43-79accdd09d3f tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed1331bcb0e4fe4a53379d1d72f650a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38faa56e5864d3aba51e1e8351e3a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:57.251158 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-6f863ec8-af32-4240-bf43-79accdd09d3f tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb" status: 200 len: 1553 microversion: 2.1 time: 0.151242 Dec 15 13:37:57.251731 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 467/924] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:57 2021] GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:58.268636 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-8e60e2ca-04e6-48f7-8f1e-c4d7de5d0aad tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:58.269258 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-8e60e2ca-04e6-48f7-8f1e-c4d7de5d0aad tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:58.275603 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8e60e2ca-04e6-48f7-8f1e-c4d7de5d0aad tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:58.276060 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8e60e2ca-04e6-48f7-8f1e-c4d7de5d0aad tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:58.276850 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8e60e2ca-04e6-48f7-8f1e-c4d7de5d0aad tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:58.277293 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8e60e2ca-04e6-48f7-8f1e-c4d7de5d0aad tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:58.402583 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-8e60e2ca-04e6-48f7-8f1e-c4d7de5d0aad tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed1331bcb0e4fe4a53379d1d72f650a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38faa56e5864d3aba51e1e8351e3a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:58.409919 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-8e60e2ca-04e6-48f7-8f1e-c4d7de5d0aad tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb" status: 200 len: 1553 microversion: 2.1 time: 0.144983 Dec 15 13:37:58.410490 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 458/925] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:58 2021] GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb => generated 1553 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:59.426508 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-6e993e24-ebe4-461e-a72e-7340410e6ee6 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:59.427142 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-6e993e24-ebe4-461e-a72e-7340410e6ee6 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:59.433362 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6e993e24-ebe4-461e-a72e-7340410e6ee6 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:59.433808 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6e993e24-ebe4-461e-a72e-7340410e6ee6 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:59.435199 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6e993e24-ebe4-461e-a72e-7340410e6ee6 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:59.435632 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6e993e24-ebe4-461e-a72e-7340410e6ee6 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:59.566538 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-6e993e24-ebe4-461e-a72e-7340410e6ee6 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed1331bcb0e4fe4a53379d1d72f650a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38faa56e5864d3aba51e1e8351e3a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:59.574066 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-6e993e24-ebe4-461e-a72e-7340410e6ee6 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb" status: 200 len: 1553 microversion: 2.1 time: 0.151189 Dec 15 13:37:59.574638 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 468/926] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:59 2021] GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:00.591883 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-47e72f6b-b2eb-4fe4-a776-2bce21e48075 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:00.592479 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-47e72f6b-b2eb-4fe4-a776-2bce21e48075 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:00.598730 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-47e72f6b-b2eb-4fe4-a776-2bce21e48075 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:00.599213 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-47e72f6b-b2eb-4fe4-a776-2bce21e48075 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:00.599990 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-47e72f6b-b2eb-4fe4-a776-2bce21e48075 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:00.600425 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-47e72f6b-b2eb-4fe4-a776-2bce21e48075 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:00.730656 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-47e72f6b-b2eb-4fe4-a776-2bce21e48075 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed1331bcb0e4fe4a53379d1d72f650a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38faa56e5864d3aba51e1e8351e3a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:00.738630 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-47e72f6b-b2eb-4fe4-a776-2bce21e48075 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb" status: 200 len: 1553 microversion: 2.1 time: 0.150436 Dec 15 13:38:00.739263 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 459/927] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:00 2021] GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:01.756089 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-62ada7a2-043d-40e9-8765-c117b6054206 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:01.756712 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-62ada7a2-043d-40e9-8765-c117b6054206 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:01.764384 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-62ada7a2-043d-40e9-8765-c117b6054206 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:01.764384 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-62ada7a2-043d-40e9-8765-c117b6054206 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:01.766712 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-62ada7a2-043d-40e9-8765-c117b6054206 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:01.766712 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-62ada7a2-043d-40e9-8765-c117b6054206 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:01.899007 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-62ada7a2-043d-40e9-8765-c117b6054206 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed1331bcb0e4fe4a53379d1d72f650a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38faa56e5864d3aba51e1e8351e3a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:01.906348 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-62ada7a2-043d-40e9-8765-c117b6054206 tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb" status: 200 len: 1553 microversion: 2.1 time: 0.153978 Dec 15 13:38:01.907220 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 469/928] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:01 2021] GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:02.256181 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-14f0c6aa-72a8-42a5-9053-9d85ad21cbc6 req-0ced783e-56ad-4e21-9bcc-0eec2c010dbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f21e20b-c80e-408b-849e-cf9e27127cbb", "name": "network-vif-deleted", "tag": "f90cb0df-c11c-44a8-b09b-274188bbac57"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:38:02.257671 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:38:02.257671 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: warnings.warn(msg) Dec 15 13:38:02.265570 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-14f0c6aa-72a8-42a5-9053-9d85ad21cbc6 req-0ced783e-56ad-4e21-9bcc-0eec2c010dbb service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:02.266023 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-14f0c6aa-72a8-42a5-9053-9d85ad21cbc6 req-0ced783e-56ad-4e21-9bcc-0eec2c010dbb service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:02.277016 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-14f0c6aa-72a8-42a5-9053-9d85ad21cbc6 req-0ced783e-56ad-4e21-9bcc-0eec2c010dbb service nova] Creating event network-vif-deleted:f90cb0df-c11c-44a8-b09b-274188bbac57 for instance 9f21e20b-c80e-408b-849e-cf9e27127cbb on hv-cinder-81322 Dec 15 13:38:02.282503 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-14f0c6aa-72a8-42a5-9053-9d85ad21cbc6 req-0ced783e-56ad-4e21-9bcc-0eec2c010dbb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029931 Dec 15 13:38:02.283071 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 460/929] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:38:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:38:02.923994 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-4a30c45f-14fe-4bf6-8803-bca3728909ec tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:02.924685 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-4a30c45f-14fe-4bf6-8803-bca3728909ec tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] [instance: 9f21e20b-c80e-408b-849e-cf9e27127cbb] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:02.931118 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4a30c45f-14fe-4bf6-8803-bca3728909ec tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:02.931587 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4a30c45f-14fe-4bf6-8803-bca3728909ec tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:02.932387 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4a30c45f-14fe-4bf6-8803-bca3728909ec tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:02.932833 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4a30c45f-14fe-4bf6-8803-bca3728909ec tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:02.948121 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.wsgi [None req-4a30c45f-14fe-4bf6-8803-bca3728909ec tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] HTTP exception thrown: Instance 9f21e20b-c80e-408b-849e-cf9e27127cbb could not be found. Dec 15 13:38:02.948859 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-4a30c45f-14fe-4bf6-8803-bca3728909ec tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Returning 404 to user: Instance 9f21e20b-c80e-408b-849e-cf9e27127cbb could not be found. {{(pid=116942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:38:02.949826 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-4a30c45f-14fe-4bf6-8803-bca3728909ec tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb" status: 404 len: 111 microversion: 2.1 time: 0.029776 Dec 15 13:38:02.950528 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 470/930] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:02 2021] GET /compute/v2.1/servers/9f21e20b-c80e-408b-849e-cf9e27127cbb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:38:02.959057 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-eb4da437-8b9e-4153-b010-894e5343f81b tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] Calling method '.version_select at 0x7ff50f4d23a0>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:02.976656 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-eb4da437-8b9e-4153-b010-894e5343f81b tempest-TestMinimumBasicScenario-1440892706 tempest-TestMinimumBasicScenario-1440892706-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-268205629" status: 202 len: 0 microversion: 2.1 time: 0.021578 Dec 15 13:38:02.977309 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 461/931] 10.222.0.60 () {58 vars in 1268 bytes} [Wed Dec 15 13:38:02 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-268205629 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:38:05.061840 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-724f9482-3430-4ee5-a8d0-dccf42a64ddf tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:05.062539 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-724f9482-3430-4ee5-a8d0-dccf42a64ddf tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] [instance: 93bf7202-d763-46e8-a6ff-ff6b87ee9ad6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:05.068670 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-724f9482-3430-4ee5-a8d0-dccf42a64ddf tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:05.069130 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-724f9482-3430-4ee5-a8d0-dccf42a64ddf tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:05.069932 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-724f9482-3430-4ee5-a8d0-dccf42a64ddf tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:05.070380 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-724f9482-3430-4ee5-a8d0-dccf42a64ddf tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:05.155704 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.objects.instance [None req-724f9482-3430-4ee5-a8d0-dccf42a64ddf tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lazy-loading 'services' on Instance uuid 93bf7202-d763-46e8-a6ff-ff6b87ee9ad6 {{(pid=116942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:38:05.230065 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-724f9482-3430-4ee5-a8d0-dccf42a64ddf tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] 10.222.0.60 "DELETE /compute/v2.1/servers/93bf7202-d763-46e8-a6ff-ff6b87ee9ad6/os-volume_attachments/66032f01-2617-4670-9c1c-ba0ba5cbb322" status: 202 len: 0 microversion: 2.1 time: 0.172358 Dec 15 13:38:05.232191 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 471/932] 10.222.0.60 () {58 vars in 1415 bytes} [Wed Dec 15 13:38:05 2021] DELETE /compute/v2.1/servers/93bf7202-d763-46e8-a6ff-ff6b87ee9ad6/os-volume_attachments/66032f01-2617-4670-9c1c-ba0ba5cbb322 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:38:06.347880 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-6ed920e2-83e3-4777-beb7-26ab19410915 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:06.348494 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-6ed920e2-83e3-4777-beb7-26ab19410915 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] [instance: 93bf7202-d763-46e8-a6ff-ff6b87ee9ad6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:06.355375 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6ed920e2-83e3-4777-beb7-26ab19410915 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:06.355827 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6ed920e2-83e3-4777-beb7-26ab19410915 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:06.356841 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6ed920e2-83e3-4777-beb7-26ab19410915 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:06.357278 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6ed920e2-83e3-4777-beb7-26ab19410915 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:06.384985 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-6ed920e2-83e3-4777-beb7-26ab19410915 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] [instance: 93bf7202-d763-46e8-a6ff-ff6b87ee9ad6] Going to try to terminate instance {{(pid=116941) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:38:06.479302 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-6ed920e2-83e3-4777-beb7-26ab19410915 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] 10.222.0.60 "DELETE /compute/v2.1/servers/93bf7202-d763-46e8-a6ff-ff6b87ee9ad6" status: 204 len: 0 microversion: 2.1 time: 0.135880 Dec 15 13:38:06.485894 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 462/933] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Dec 15 13:38:06 2021] DELETE /compute/v2.1/servers/93bf7202-d763-46e8-a6ff-ff6b87ee9ad6 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:38:06.492065 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ca466a91-4da3-458c-8084-7c0de2a0f862 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:06.492873 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ca466a91-4da3-458c-8084-7c0de2a0f862 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] [instance: 93bf7202-d763-46e8-a6ff-ff6b87ee9ad6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:06.500113 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ca466a91-4da3-458c-8084-7c0de2a0f862 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:06.500980 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ca466a91-4da3-458c-8084-7c0de2a0f862 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:06.502241 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ca466a91-4da3-458c-8084-7c0de2a0f862 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:06.503328 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ca466a91-4da3-458c-8084-7c0de2a0f862 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:06.657840 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-ca466a91-4da3-458c-8084-7c0de2a0f862 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa1533801dc4fa0b79d8662414749d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8066a245289451b8a7cc12d4311b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:06.665459 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ca466a91-4da3-458c-8084-7c0de2a0f862 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] 10.222.0.60 "GET /compute/v2.1/servers/93bf7202-d763-46e8-a6ff-ff6b87ee9ad6" status: 200 len: 1514 microversion: 2.1 time: 0.177983 Dec 15 13:38:06.666174 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 472/934] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:06 2021] GET /compute/v2.1/servers/93bf7202-d763-46e8-a6ff-ff6b87ee9ad6 => generated 1514 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:38:07.683643 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-89e43e6f-67f0-46e7-88f9-b84e84dc4984 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:07.684352 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-89e43e6f-67f0-46e7-88f9-b84e84dc4984 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] [instance: 93bf7202-d763-46e8-a6ff-ff6b87ee9ad6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:07.692267 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-89e43e6f-67f0-46e7-88f9-b84e84dc4984 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:07.692717 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-89e43e6f-67f0-46e7-88f9-b84e84dc4984 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:07.693512 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-89e43e6f-67f0-46e7-88f9-b84e84dc4984 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:07.693947 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-89e43e6f-67f0-46e7-88f9-b84e84dc4984 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:07.900065 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-89e43e6f-67f0-46e7-88f9-b84e84dc4984 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa1533801dc4fa0b79d8662414749d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8066a245289451b8a7cc12d4311b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:07.907951 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-89e43e6f-67f0-46e7-88f9-b84e84dc4984 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] 10.222.0.60 "GET /compute/v2.1/servers/93bf7202-d763-46e8-a6ff-ff6b87ee9ad6" status: 200 len: 1514 microversion: 2.1 time: 0.228526 Dec 15 13:38:07.908534 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 463/935] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:07 2021] GET /compute/v2.1/servers/93bf7202-d763-46e8-a6ff-ff6b87ee9ad6 => generated 1514 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:08.925454 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-30469cec-7f07-4ccd-971c-b6b04918f8c8 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:08.926076 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-30469cec-7f07-4ccd-971c-b6b04918f8c8 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] [instance: 93bf7202-d763-46e8-a6ff-ff6b87ee9ad6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:08.934116 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-30469cec-7f07-4ccd-971c-b6b04918f8c8 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:08.935191 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-30469cec-7f07-4ccd-971c-b6b04918f8c8 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:08.936002 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-30469cec-7f07-4ccd-971c-b6b04918f8c8 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:08.936423 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-30469cec-7f07-4ccd-971c-b6b04918f8c8 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:09.015746 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-30469cec-7f07-4ccd-971c-b6b04918f8c8 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa1533801dc4fa0b79d8662414749d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8066a245289451b8a7cc12d4311b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:09.019629 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-597d2b25-61eb-4f40-8bb9-6c803bd5e081 req-7fba883c-751d-461c-a9b9-0217d10150f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93bf7202-d763-46e8-a6ff-ff6b87ee9ad6", "name": "network-vif-deleted", "tag": "fb1dabff-ae3a-4d15-a31e-f209b3bfbd0f"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:38:09.020561 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:38:09.020561 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: warnings.warn(msg) Dec 15 13:38:09.023717 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-30469cec-7f07-4ccd-971c-b6b04918f8c8 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] 10.222.0.60 "GET /compute/v2.1/servers/93bf7202-d763-46e8-a6ff-ff6b87ee9ad6" status: 200 len: 1472 microversion: 2.1 time: 0.101790 Dec 15 13:38:09.033403 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 473/936] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:08 2021] GET /compute/v2.1/servers/93bf7202-d763-46e8-a6ff-ff6b87ee9ad6 => generated 1472 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:38:09.033582 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-597d2b25-61eb-4f40-8bb9-6c803bd5e081 req-7fba883c-751d-461c-a9b9-0217d10150f8 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:09.033582 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-597d2b25-61eb-4f40-8bb9-6c803bd5e081 req-7fba883c-751d-461c-a9b9-0217d10150f8 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:09.040412 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-597d2b25-61eb-4f40-8bb9-6c803bd5e081 req-7fba883c-751d-461c-a9b9-0217d10150f8 service nova] Creating event network-vif-deleted:fb1dabff-ae3a-4d15-a31e-f209b3bfbd0f for instance 93bf7202-d763-46e8-a6ff-ff6b87ee9ad6 on hv-cinder-81322 Dec 15 13:38:09.045762 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-597d2b25-61eb-4f40-8bb9-6c803bd5e081 req-7fba883c-751d-461c-a9b9-0217d10150f8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030665 Dec 15 13:38:09.046632 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 464/937] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:38:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:38:09.358858 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-f1a2987d-b2d8-4cc5-aa3b-83a61f8cae30 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:09.359370 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-f1a2987d-b2d8-4cc5-aa3b-83a61f8cae30 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:09.365919 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f1a2987d-b2d8-4cc5-aa3b-83a61f8cae30 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:09.366373 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f1a2987d-b2d8-4cc5-aa3b-83a61f8cae30 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:09.367256 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f1a2987d-b2d8-4cc5-aa3b-83a61f8cae30 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:09.367691 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f1a2987d-b2d8-4cc5-aa3b-83a61f8cae30 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:09.396670 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-f1a2987d-b2d8-4cc5-aa3b-83a61f8cae30 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/os-volume_attachments/809346d8-d3f4-4172-88b7-fdc8e000c19f" status: 200 len: 194 microversion: 2.20 time: 0.045341 Dec 15 13:38:09.397265 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 474/938] 10.222.0.60 () {60 vars in 1453 bytes} [Wed Dec 15 13:38:09 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/os-volume_attachments/809346d8-d3f4-4172-88b7-fdc8e000c19f => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:38:09.470437 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-15ebec86-846b-4b71-afdb-71439a6202ae tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:09.471375 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-15ebec86-846b-4b71-afdb-71439a6202ae tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:09.478195 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-15ebec86-846b-4b71-afdb-71439a6202ae tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:09.478655 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-15ebec86-846b-4b71-afdb-71439a6202ae tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:09.479585 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-15ebec86-846b-4b71-afdb-71439a6202ae tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:09.480206 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-15ebec86-846b-4b71-afdb-71439a6202ae tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:09.565953 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.objects.instance [None req-15ebec86-846b-4b71-afdb-71439a6202ae tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lazy-loading 'services' on Instance uuid 00671676-47cb-4266-b9e5-61c7fb120355 {{(pid=116941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:38:09.640026 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-15ebec86-846b-4b71-afdb-71439a6202ae tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "DELETE /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/os-volume_attachments/809346d8-d3f4-4172-88b7-fdc8e000c19f" status: 202 len: 0 microversion: 2.20 time: 0.174366 Dec 15 13:38:09.640705 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 465/939] 10.222.0.60 () {60 vars in 1456 bytes} [Wed Dec 15 13:38:09 2021] DELETE /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/os-volume_attachments/809346d8-d3f4-4172-88b7-fdc8e000c19f => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:38:09.652321 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-7939a458-e16f-4889-87cd-d0bbf6de8109 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:09.655435 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-7939a458-e16f-4889-87cd-d0bbf6de8109 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:09.664969 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7939a458-e16f-4889-87cd-d0bbf6de8109 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:09.665793 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7939a458-e16f-4889-87cd-d0bbf6de8109 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:09.666969 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7939a458-e16f-4889-87cd-d0bbf6de8109 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:09.667621 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7939a458-e16f-4889-87cd-d0bbf6de8109 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:09.714762 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-7939a458-e16f-4889-87cd-d0bbf6de8109 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.069436 Dec 15 13:38:09.715379 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 475/940] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Dec 15 13:38:09 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:38:10.041138 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-0f60d2d8-823f-4642-8924-e1e604be38e6 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:10.041754 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-0f60d2d8-823f-4642-8924-e1e604be38e6 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] [instance: 93bf7202-d763-46e8-a6ff-ff6b87ee9ad6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:10.047812 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0f60d2d8-823f-4642-8924-e1e604be38e6 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:10.048263 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0f60d2d8-823f-4642-8924-e1e604be38e6 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:10.049036 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0f60d2d8-823f-4642-8924-e1e604be38e6 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:10.049474 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0f60d2d8-823f-4642-8924-e1e604be38e6 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:10.064027 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.wsgi [None req-0f60d2d8-823f-4642-8924-e1e604be38e6 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] HTTP exception thrown: Instance 93bf7202-d763-46e8-a6ff-ff6b87ee9ad6 could not be found. Dec 15 13:38:10.064654 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-0f60d2d8-823f-4642-8924-e1e604be38e6 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Returning 404 to user: Instance 93bf7202-d763-46e8-a6ff-ff6b87ee9ad6 could not be found. {{(pid=116941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:38:10.065484 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-0f60d2d8-823f-4642-8924-e1e604be38e6 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] 10.222.0.60 "GET /compute/v2.1/servers/93bf7202-d763-46e8-a6ff-ff6b87ee9ad6" status: 404 len: 111 microversion: 2.1 time: 0.028947 Dec 15 13:38:10.066041 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 466/941] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:10 2021] GET /compute/v2.1/servers/93bf7202-d763-46e8-a6ff-ff6b87ee9ad6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:38:10.731400 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-651218fe-533b-46c9-adf7-58045f9f4222 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:10.734484 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-651218fe-533b-46c9-adf7-58045f9f4222 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:10.740588 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-651218fe-533b-46c9-adf7-58045f9f4222 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:10.741049 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-651218fe-533b-46c9-adf7-58045f9f4222 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:10.741857 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-651218fe-533b-46c9-adf7-58045f9f4222 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:10.742315 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-651218fe-533b-46c9-adf7-58045f9f4222 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:10.772963 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-651218fe-533b-46c9-adf7-58045f9f4222 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047680 Dec 15 13:38:10.773770 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 476/942] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Dec 15 13:38:10 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:38:11.784975 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-3a935d07-a4d7-4193-81a4-5503a384c4b1 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:11.785988 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-3a935d07-a4d7-4193-81a4-5503a384c4b1 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:11.792742 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3a935d07-a4d7-4193-81a4-5503a384c4b1 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:11.793190 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3a935d07-a4d7-4193-81a4-5503a384c4b1 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:11.794485 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3a935d07-a4d7-4193-81a4-5503a384c4b1 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:11.794975 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3a935d07-a4d7-4193-81a4-5503a384c4b1 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:11.829573 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-3a935d07-a4d7-4193-81a4-5503a384c4b1 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049086 Dec 15 13:38:11.830152 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 467/943] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Dec 15 13:38:11 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:38:12.841192 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-e0cfab93-fab5-40a1-a58c-2bd7af547dcc tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:12.842099 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-e0cfab93-fab5-40a1-a58c-2bd7af547dcc tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:12.848348 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e0cfab93-fab5-40a1-a58c-2bd7af547dcc tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:12.848798 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e0cfab93-fab5-40a1-a58c-2bd7af547dcc tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:12.849579 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e0cfab93-fab5-40a1-a58c-2bd7af547dcc tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:12.850012 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e0cfab93-fab5-40a1-a58c-2bd7af547dcc tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:12.879854 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-e0cfab93-fab5-40a1-a58c-2bd7af547dcc tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042487 Dec 15 13:38:12.880425 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 477/944] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Dec 15 13:38:12 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:38:13.891363 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-dc4f95ca-cd6c-4b0d-9799-b671a523841a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:13.892298 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-dc4f95ca-cd6c-4b0d-9799-b671a523841a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:13.898532 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-dc4f95ca-cd6c-4b0d-9799-b671a523841a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:13.899019 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-dc4f95ca-cd6c-4b0d-9799-b671a523841a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:13.899793 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-dc4f95ca-cd6c-4b0d-9799-b671a523841a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:13.900224 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-dc4f95ca-cd6c-4b0d-9799-b671a523841a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:13.928689 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-dc4f95ca-cd6c-4b0d-9799-b671a523841a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041183 Dec 15 13:38:13.929234 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 468/945] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Dec 15 13:38:13 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:38:14.940462 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-80773095-c7fa-4542-b123-267dd39e8cc4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:14.941871 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-80773095-c7fa-4542-b123-267dd39e8cc4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:14.949999 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-80773095-c7fa-4542-b123-267dd39e8cc4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:14.950448 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-80773095-c7fa-4542-b123-267dd39e8cc4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:14.951262 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-80773095-c7fa-4542-b123-267dd39e8cc4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:14.951699 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-80773095-c7fa-4542-b123-267dd39e8cc4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:14.979928 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-80773095-c7fa-4542-b123-267dd39e8cc4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043246 Dec 15 13:38:14.980480 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 478/946] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Dec 15 13:38:14 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:38:15.992953 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-082c09f7-141a-4f47-b02c-ca313382bf91 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:15.993867 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-082c09f7-141a-4f47-b02c-ca313382bf91 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:16.000278 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-082c09f7-141a-4f47-b02c-ca313382bf91 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:16.000722 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-082c09f7-141a-4f47-b02c-ca313382bf91 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:16.001676 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-082c09f7-141a-4f47-b02c-ca313382bf91 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:16.002193 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-082c09f7-141a-4f47-b02c-ca313382bf91 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:16.029775 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-082c09f7-141a-4f47-b02c-ca313382bf91 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.040646 Dec 15 13:38:16.030316 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 469/947] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Dec 15 13:38:15 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:16.084041 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-35a39755-045a-43dc-9e21-0d46774bed56 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:16.084545 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-35a39755-045a-43dc-9e21-0d46774bed56 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:16.090740 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-35a39755-045a-43dc-9e21-0d46774bed56 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:16.091248 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-35a39755-045a-43dc-9e21-0d46774bed56 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:16.092037 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-35a39755-045a-43dc-9e21-0d46774bed56 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:16.092480 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-35a39755-045a-43dc-9e21-0d46774bed56 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:16.116086 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-35a39755-045a-43dc-9e21-0d46774bed56 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Going to try to terminate instance {{(pid=116942) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:38:16.192090 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-35a39755-045a-43dc-9e21-0d46774bed56 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "DELETE /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 204 len: 0 microversion: 2.20 time: 0.111291 Dec 15 13:38:16.193038 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 479/948] 10.222.0.60 () {60 vars in 1279 bytes} [Wed Dec 15 13:38:16 2021] DELETE /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 15 13:38:16.201729 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-77f50c06-0baa-47ed-87d2-53456cc420ed tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:16.202343 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-77f50c06-0baa-47ed-87d2-53456cc420ed tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:16.208339 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-77f50c06-0baa-47ed-87d2-53456cc420ed tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:16.208802 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-77f50c06-0baa-47ed-87d2-53456cc420ed tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:16.209584 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-77f50c06-0baa-47ed-87d2-53456cc420ed tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:16.210027 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-77f50c06-0baa-47ed-87d2-53456cc420ed tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:16.338661 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-77f50c06-0baa-47ed-87d2-53456cc420ed tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:16.346421 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-77f50c06-0baa-47ed-87d2-53456cc420ed tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:16.347950 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-77f50c06-0baa-47ed-87d2-53456cc420ed tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:16.349112 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-77f50c06-0baa-47ed-87d2-53456cc420ed tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1724 microversion: 2.20 time: 0.151959 Dec 15 13:38:16.349675 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 470/949] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:38:16 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:38:17.369593 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ffa7b8fb-5b75-43be-bacc-10a943288232 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:17.370289 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ffa7b8fb-5b75-43be-bacc-10a943288232 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:17.377134 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ffa7b8fb-5b75-43be-bacc-10a943288232 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:17.377584 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ffa7b8fb-5b75-43be-bacc-10a943288232 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:17.378357 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ffa7b8fb-5b75-43be-bacc-10a943288232 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:17.378791 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ffa7b8fb-5b75-43be-bacc-10a943288232 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:17.508265 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-ffa7b8fb-5b75-43be-bacc-10a943288232 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:17.515991 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-ffa7b8fb-5b75-43be-bacc-10a943288232 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:17.517485 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-ffa7b8fb-5b75-43be-bacc-10a943288232 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:17.518635 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ffa7b8fb-5b75-43be-bacc-10a943288232 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1724 microversion: 2.20 time: 0.153991 Dec 15 13:38:17.519226 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 480/950] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:38:17 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:38:18.536445 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-4d1453bc-194b-43b4-b89d-2d5fa5a26f09 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:18.537056 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-4d1453bc-194b-43b4-b89d-2d5fa5a26f09 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:18.543471 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4d1453bc-194b-43b4-b89d-2d5fa5a26f09 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:18.543924 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4d1453bc-194b-43b4-b89d-2d5fa5a26f09 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:18.544703 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4d1453bc-194b-43b4-b89d-2d5fa5a26f09 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:18.545646 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4d1453bc-194b-43b4-b89d-2d5fa5a26f09 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:18.676615 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-4d1453bc-194b-43b4-b89d-2d5fa5a26f09 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:18.684172 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-4d1453bc-194b-43b4-b89d-2d5fa5a26f09 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:18.685745 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-4d1453bc-194b-43b4-b89d-2d5fa5a26f09 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:18.686923 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-4d1453bc-194b-43b4-b89d-2d5fa5a26f09 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1724 microversion: 2.20 time: 0.154162 Dec 15 13:38:18.687478 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 471/951] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:38:18 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:38:19.706033 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-b793df26-6675-4c5e-ab68-ee9fb50d8e0d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:19.706636 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-b793df26-6675-4c5e-ab68-ee9fb50d8e0d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:19.712893 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b793df26-6675-4c5e-ab68-ee9fb50d8e0d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:19.713341 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b793df26-6675-4c5e-ab68-ee9fb50d8e0d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:19.714112 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b793df26-6675-4c5e-ab68-ee9fb50d8e0d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:19.714574 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b793df26-6675-4c5e-ab68-ee9fb50d8e0d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:19.841267 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-b793df26-6675-4c5e-ab68-ee9fb50d8e0d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:19.848897 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-b793df26-6675-4c5e-ab68-ee9fb50d8e0d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:19.850456 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-b793df26-6675-4c5e-ab68-ee9fb50d8e0d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:19.851633 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-b793df26-6675-4c5e-ab68-ee9fb50d8e0d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1724 microversion: 2.20 time: 0.150025 Dec 15 13:38:19.852208 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 481/952] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:38:19 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:38:20.869147 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-4440434b-62b2-411b-9441-766c87baf259 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:20.869759 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-4440434b-62b2-411b-9441-766c87baf259 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:20.876716 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4440434b-62b2-411b-9441-766c87baf259 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:20.877172 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4440434b-62b2-411b-9441-766c87baf259 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:20.877954 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4440434b-62b2-411b-9441-766c87baf259 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:20.878396 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4440434b-62b2-411b-9441-766c87baf259 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:21.007958 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-4440434b-62b2-411b-9441-766c87baf259 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:21.015606 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-4440434b-62b2-411b-9441-766c87baf259 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:21.017087 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-4440434b-62b2-411b-9441-766c87baf259 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:21.018238 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-4440434b-62b2-411b-9441-766c87baf259 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1724 microversion: 2.20 time: 0.152833 Dec 15 13:38:21.018803 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 472/953] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:38:20 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:38:21.972325 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-2d6c4fc5-6197-4fcd-a150-473100509a92 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-95360148", "imageRef": "cfccedbb-7169-47ec-9bae-d4829cba54e1", "flavorRef": "452", "networks": [{"uuid": "b6a3f70f-5a71-4bc1-9b46-d5eeb134e3f0"}]}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:38:22.027613 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.network.neutron [None req-2d6c4fc5-6197-4fcd-a150-473100509a92 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] validate_networks() for [('b6a3f70f-5a71-4bc1-9b46-d5eeb134e3f0', None, None, None, None, None)] {{(pid=116942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:38:22.035908 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-561736d3-f07d-4e6a-8604-735d95265993 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:22.036529 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-561736d3-f07d-4e6a-8604-735d95265993 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:22.043385 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-561736d3-f07d-4e6a-8604-735d95265993 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:22.043847 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-561736d3-f07d-4e6a-8604-735d95265993 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:22.044648 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-561736d3-f07d-4e6a-8604-735d95265993 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:22.045332 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-561736d3-f07d-4e6a-8604-735d95265993 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:22.254644 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-561736d3-f07d-4e6a-8604-735d95265993 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:22.263294 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-561736d3-f07d-4e6a-8604-735d95265993 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:22.265544 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-561736d3-f07d-4e6a-8604-735d95265993 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:22.266715 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-561736d3-f07d-4e6a-8604-735d95265993 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1724 microversion: 2.20 time: 0.234522 Dec 15 13:38:22.267476 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 473/954] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:38:22 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1724 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:38:22.534545 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-2d6c4fc5-6197-4fcd-a150-473100509a92 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Flavor limits 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:38:22.534991 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-2d6c4fc5-6197-4fcd-a150-473100509a92 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Image limits 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:38:22.535476 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-2d6c4fc5-6197-4fcd-a150-473100509a92 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Flavor pref 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:38:22.535924 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-2d6c4fc5-6197-4fcd-a150-473100509a92 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Image pref 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:38:22.536341 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-2d6c4fc5-6197-4fcd-a150-473100509a92 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:38:22.553092 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2d6c4fc5-6197-4fcd-a150-473100509a92 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:22.553569 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2d6c4fc5-6197-4fcd-a150-473100509a92 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:22.554449 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2d6c4fc5-6197-4fcd-a150-473100509a92 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:22.554949 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2d6c4fc5-6197-4fcd-a150-473100509a92 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:22.572178 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-2d6c4fc5-6197-4fcd-a150-473100509a92 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Getting quotas for project b8066a245289451b8a7cc12d4311b412. Resources: {'cores', 'instances', 'ram'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:38:22.576631 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-2d6c4fc5-6197-4fcd-a150-473100509a92 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Getting quotas for user 1fa1533801dc4fa0b79d8662414749d8 and project b8066a245289451b8a7cc12d4311b412. Resources: {'cores', 'instances', 'ram'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:38:22.589890 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-2d6c4fc5-6197-4fcd-a150-473100509a92 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Going to run 1 instances... {{(pid=116942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:38:22.592533 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-2d6c4fc5-6197-4fcd-a150-473100509a92 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] [instance: 3f40169a-0190-4f74-9297-62373f9d6d03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cfccedbb-7169-47ec-9bae-d4829cba54e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:38:22.652720 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-2d6c4fc5-6197-4fcd-a150-473100509a92 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.683909 Dec 15 13:38:22.658707 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 482/955] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Dec 15 13:38:21 2021] POST /compute/v2.1/servers => generated 380 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 13:38:22.669610 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-86deff31-4a27-431a-a457-17a473af19d1 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:22.670804 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-86deff31-4a27-431a-a457-17a473af19d1 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] [instance: 3f40169a-0190-4f74-9297-62373f9d6d03] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:22.737317 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-86deff31-4a27-431a-a457-17a473af19d1 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa1533801dc4fa0b79d8662414749d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8066a245289451b8a7cc12d4311b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:22.747138 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-86deff31-4a27-431a-a457-17a473af19d1 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] 10.222.0.60 "GET /compute/v2.1/servers/3f40169a-0190-4f74-9297-62373f9d6d03" status: 200 len: 1217 microversion: 2.1 time: 0.083599 Dec 15 13:38:22.747724 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 474/956] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:22 2021] GET /compute/v2.1/servers/3f40169a-0190-4f74-9297-62373f9d6d03 => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:22.872144 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-9929aa46-fde1-4fbd-a6e8-1af117c13719 req-1c590bb3-afb4-4fec-a511-b4b5693a808a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00671676-47cb-4266-b9e5-61c7fb120355", "name": "network-vif-deleted", "tag": "33030795-e868-427d-8a6a-6d48523668bc"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:38:22.873721 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:38:22.873721 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: warnings.warn(msg) Dec 15 13:38:22.885485 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-9929aa46-fde1-4fbd-a6e8-1af117c13719 req-1c590bb3-afb4-4fec-a511-b4b5693a808a service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:22.885790 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-9929aa46-fde1-4fbd-a6e8-1af117c13719 req-1c590bb3-afb4-4fec-a511-b4b5693a808a service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:22.911540 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-9929aa46-fde1-4fbd-a6e8-1af117c13719 req-1c590bb3-afb4-4fec-a511-b4b5693a808a service nova] Creating event network-vif-deleted:33030795-e868-427d-8a6a-6d48523668bc for instance 00671676-47cb-4266-b9e5-61c7fb120355 on hv-cinder-81322 Dec 15 13:38:22.921110 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-9929aa46-fde1-4fbd-a6e8-1af117c13719 req-1c590bb3-afb4-4fec-a511-b4b5693a808a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051999 Dec 15 13:38:22.922251 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 483/957] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:38:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:38:23.285100 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-50d961ad-35ad-4a75-80a5-ffd5e792d3a4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:23.285825 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-50d961ad-35ad-4a75-80a5-ffd5e792d3a4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:23.292883 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-50d961ad-35ad-4a75-80a5-ffd5e792d3a4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:23.293259 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-50d961ad-35ad-4a75-80a5-ffd5e792d3a4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:23.294089 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-50d961ad-35ad-4a75-80a5-ffd5e792d3a4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:23.294522 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-50d961ad-35ad-4a75-80a5-ffd5e792d3a4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:23.334921 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-50d961ad-35ad-4a75-80a5-ffd5e792d3a4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:23.335558 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-50d961ad-35ad-4a75-80a5-ffd5e792d3a4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:23.336194 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.objects.instance [None req-50d961ad-35ad-4a75-80a5-ffd5e792d3a4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lazy-loading 'fault' on Instance uuid 00671676-47cb-4266-b9e5-61c7fb120355 {{(pid=116941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:38:23.389488 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-50d961ad-35ad-4a75-80a5-ffd5e792d3a4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:23.398227 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-50d961ad-35ad-4a75-80a5-ffd5e792d3a4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:23.399764 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-50d961ad-35ad-4a75-80a5-ffd5e792d3a4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:23.400973 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-50d961ad-35ad-4a75-80a5-ffd5e792d3a4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 200 len: 1371 microversion: 2.20 time: 0.119571 Dec 15 13:38:23.401855 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 475/958] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:38:23 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 1371 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:38:23.767424 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-aec2293f-bb63-40ae-95c6-58e98d7d08ac tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:23.768406 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-aec2293f-bb63-40ae-95c6-58e98d7d08ac tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] [instance: 3f40169a-0190-4f74-9297-62373f9d6d03] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:23.781283 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-aec2293f-bb63-40ae-95c6-58e98d7d08ac tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:23.782080 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-aec2293f-bb63-40ae-95c6-58e98d7d08ac tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:23.783165 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-aec2293f-bb63-40ae-95c6-58e98d7d08ac tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:23.783799 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-aec2293f-bb63-40ae-95c6-58e98d7d08ac tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:23.854793 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-aec2293f-bb63-40ae-95c6-58e98d7d08ac tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa1533801dc4fa0b79d8662414749d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8066a245289451b8a7cc12d4311b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:23.863687 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-aec2293f-bb63-40ae-95c6-58e98d7d08ac tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] 10.222.0.60 "GET /compute/v2.1/servers/3f40169a-0190-4f74-9297-62373f9d6d03" status: 200 len: 1277 microversion: 2.1 time: 0.102443 Dec 15 13:38:23.864579 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 484/959] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:23 2021] GET /compute/v2.1/servers/3f40169a-0190-4f74-9297-62373f9d6d03 => generated 1277 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:24.419686 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-1ea8c72b-ab41-44ea-a1a6-b879bd849fa5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:24.420889 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-1ea8c72b-ab41-44ea-a1a6-b879bd849fa5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:24.429977 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1ea8c72b-ab41-44ea-a1a6-b879bd849fa5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:24.430431 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1ea8c72b-ab41-44ea-a1a6-b879bd849fa5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:24.431240 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1ea8c72b-ab41-44ea-a1a6-b879bd849fa5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:24.431677 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1ea8c72b-ab41-44ea-a1a6-b879bd849fa5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:24.445109 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.wsgi [None req-1ea8c72b-ab41-44ea-a1a6-b879bd849fa5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] HTTP exception thrown: Instance 00671676-47cb-4266-b9e5-61c7fb120355 could not be found. Dec 15 13:38:24.445798 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-1ea8c72b-ab41-44ea-a1a6-b879bd849fa5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Returning 404 to user: Instance 00671676-47cb-4266-b9e5-61c7fb120355 could not be found. {{(pid=116941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:38:24.446759 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-1ea8c72b-ab41-44ea-a1a6-b879bd849fa5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 404 len: 111 microversion: 2.20 time: 0.030748 Dec 15 13:38:24.447471 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 476/960] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:38:24 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 15 13:38:24.461239 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-e7082214-e81d-4436-add4-e3370d090c7a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '.version_select at 0x7ff50f3f2e50>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:24.484554 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-e7082214-e81d-4436-add4-e3370d090c7a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2047121199" status: 204 len: 0 microversion: 2.20 time: 0.028506 Dec 15 13:38:24.485218 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 485/961] 10.222.0.60 () {60 vars in 1261 bytes} [Wed Dec 15 13:38:24 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2047121199 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 15 13:38:24.880205 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-e32d5b1a-e5fd-48e9-a112-e18c2c39c186 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:24.880825 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-e32d5b1a-e5fd-48e9-a112-e18c2c39c186 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] [instance: 3f40169a-0190-4f74-9297-62373f9d6d03] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:24.886641 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e32d5b1a-e5fd-48e9-a112-e18c2c39c186 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:24.887342 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e32d5b1a-e5fd-48e9-a112-e18c2c39c186 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:24.888420 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e32d5b1a-e5fd-48e9-a112-e18c2c39c186 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:24.889561 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e32d5b1a-e5fd-48e9-a112-e18c2c39c186 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:25.076240 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-e32d5b1a-e5fd-48e9-a112-e18c2c39c186 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa1533801dc4fa0b79d8662414749d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8066a245289451b8a7cc12d4311b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:25.085172 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-e32d5b1a-e5fd-48e9-a112-e18c2c39c186 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] 10.222.0.60 "GET /compute/v2.1/servers/3f40169a-0190-4f74-9297-62373f9d6d03" status: 200 len: 1317 microversion: 2.1 time: 0.208264 Dec 15 13:38:25.085691 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 477/962] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:24 2021] GET /compute/v2.1/servers/3f40169a-0190-4f74-9297-62373f9d6d03 => generated 1317 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:25.142689 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-e77d538a-422c-40fb-94c3-120af8ac380b req-3e15aae3-5261-4633-8770-0ba5aa03742b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f40169a-0190-4f74-9297-62373f9d6d03", "tag": "b276571c-8528-425e-9282-3ac695c1b993"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:38:25.144199 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:38:25.144199 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: warnings.warn(msg) Dec 15 13:38:25.154650 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-e77d538a-422c-40fb-94c3-120af8ac380b req-3e15aae3-5261-4633-8770-0ba5aa03742b service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:25.155461 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-e77d538a-422c-40fb-94c3-120af8ac380b req-3e15aae3-5261-4633-8770-0ba5aa03742b service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:25.168010 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-e77d538a-422c-40fb-94c3-120af8ac380b req-3e15aae3-5261-4633-8770-0ba5aa03742b service nova] Creating event network-changed:b276571c-8528-425e-9282-3ac695c1b993 for instance 3f40169a-0190-4f74-9297-62373f9d6d03 on hv-cinder-81322 Dec 15 13:38:25.173376 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-e77d538a-422c-40fb-94c3-120af8ac380b req-3e15aae3-5261-4633-8770-0ba5aa03742b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036593 Dec 15 13:38:25.174538 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 486/963] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:38:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:38:25.268324 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-2e3ae959-6ca5-4b4f-b24f-57144366091e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'create', calling method: .version_select at 0x7ff50f379310>, body: {"keypair": {"name": "tempest-keypair-135306928"}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:38:25.281647 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-2e3ae959-6ca5-4b4f-b24f-57144366091e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Getting quotas for project 849d4c797afe475aa474e4415f6190c0. Resources: {'key_pairs'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:38:25.285381 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-2e3ae959-6ca5-4b4f-b24f-57144366091e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Getting quotas for user 58ad05b9c93c48a4bf4d1f086b6d5ad1 and project 849d4c797afe475aa474e4415f6190c0. Resources: {'key_pairs'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:38:25.419941 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-2e3ae959-6ca5-4b4f-b24f-57144366091e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Getting quotas for project 849d4c797afe475aa474e4415f6190c0. Resources: {'key_pairs'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:38:25.425021 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-2e3ae959-6ca5-4b4f-b24f-57144366091e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Getting quotas for user 58ad05b9c93c48a4bf4d1f086b6d5ad1 and project 849d4c797afe475aa474e4415f6190c0. Resources: {'key_pairs'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:38:25.438813 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-2e3ae959-6ca5-4b4f-b24f-57144366091e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.174694 Dec 15 13:38:25.439495 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 478/964] 10.222.0.60 () {62 vars in 1198 bytes} [Wed Dec 15 13:38:25 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 176 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 15 13:38:26.101834 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-63b7bcac-7fd7-4515-9fee-d0bcc8266f25 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:26.102447 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-63b7bcac-7fd7-4515-9fee-d0bcc8266f25 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] [instance: 3f40169a-0190-4f74-9297-62373f9d6d03] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:26.108524 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-63b7bcac-7fd7-4515-9fee-d0bcc8266f25 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:26.108971 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-63b7bcac-7fd7-4515-9fee-d0bcc8266f25 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:26.109785 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-63b7bcac-7fd7-4515-9fee-d0bcc8266f25 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:26.110222 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-63b7bcac-7fd7-4515-9fee-d0bcc8266f25 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:26.241044 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-63b7bcac-7fd7-4515-9fee-d0bcc8266f25 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa1533801dc4fa0b79d8662414749d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8066a245289451b8a7cc12d4311b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:26.248318 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-63b7bcac-7fd7-4515-9fee-d0bcc8266f25 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] 10.222.0.60 "GET /compute/v2.1/servers/3f40169a-0190-4f74-9297-62373f9d6d03" status: 200 len: 1317 microversion: 2.1 time: 0.150500 Dec 15 13:38:26.248897 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 487/965] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:26 2021] GET /compute/v2.1/servers/3f40169a-0190-4f74-9297-62373f9d6d03 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:27.105022 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-fc21e2a0-e257-41d0-862b-1148d7902b79 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1549349149", "imageRef": "cfccedbb-7169-47ec-9bae-d4829cba54e1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b0016a0f-1988-46ad-b4da-048d7988271c"}], "security_groups": [{"name": "tempest-securitygroup--1941398350"}], "key_name": "tempest-keypair-135306928", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:38:27.202266 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.network.neutron [None req-fc21e2a0-e257-41d0-862b-1148d7902b79 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] validate_networks() for [('b0016a0f-1988-46ad-b4da-048d7988271c', None, None, None, None, None)] {{(pid=116941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:38:27.264813 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-63a2f963-76ac-4384-a8a2-88efe13ccad8 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:27.265423 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-63a2f963-76ac-4384-a8a2-88efe13ccad8 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] [instance: 3f40169a-0190-4f74-9297-62373f9d6d03] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:27.271526 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-63a2f963-76ac-4384-a8a2-88efe13ccad8 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:27.271970 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-63a2f963-76ac-4384-a8a2-88efe13ccad8 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:27.272753 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-63a2f963-76ac-4384-a8a2-88efe13ccad8 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:27.273236 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-63a2f963-76ac-4384-a8a2-88efe13ccad8 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:27.463372 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-63a2f963-76ac-4384-a8a2-88efe13ccad8 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa1533801dc4fa0b79d8662414749d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8066a245289451b8a7cc12d4311b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:27.471099 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-63a2f963-76ac-4384-a8a2-88efe13ccad8 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] 10.222.0.60 "GET /compute/v2.1/servers/3f40169a-0190-4f74-9297-62373f9d6d03" status: 200 len: 1317 microversion: 2.1 time: 0.209909 Dec 15 13:38:27.471689 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 488/966] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:27 2021] GET /compute/v2.1/servers/3f40169a-0190-4f74-9297-62373f9d6d03 => generated 1317 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:38:27.616064 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-fc21e2a0-e257-41d0-862b-1148d7902b79 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Flavor limits 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:38:27.616493 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-fc21e2a0-e257-41d0-862b-1148d7902b79 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Image limits 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:38:27.617001 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-fc21e2a0-e257-41d0-862b-1148d7902b79 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Flavor pref 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:38:27.617445 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-fc21e2a0-e257-41d0-862b-1148d7902b79 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Image pref 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:38:27.617860 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-fc21e2a0-e257-41d0-862b-1148d7902b79 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:38:27.626399 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-fc21e2a0-e257-41d0-862b-1148d7902b79 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:27.626874 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-fc21e2a0-e257-41d0-862b-1148d7902b79 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:27.627748 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-fc21e2a0-e257-41d0-862b-1148d7902b79 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:27.628189 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-fc21e2a0-e257-41d0-862b-1148d7902b79 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:27.644486 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-fc21e2a0-e257-41d0-862b-1148d7902b79 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Getting quotas for project 849d4c797afe475aa474e4415f6190c0. Resources: {'cores', 'instances', 'ram'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:38:27.648370 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-fc21e2a0-e257-41d0-862b-1148d7902b79 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Getting quotas for user 58ad05b9c93c48a4bf4d1f086b6d5ad1 and project 849d4c797afe475aa474e4415f6190c0. Resources: {'cores', 'instances', 'ram'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:38:27.659782 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-fc21e2a0-e257-41d0-862b-1148d7902b79 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Going to run 1 instances... {{(pid=116941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:38:27.662071 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-fc21e2a0-e257-41d0-862b-1148d7902b79 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cfccedbb-7169-47ec-9bae-d4829cba54e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:38:27.707293 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-fc21e2a0-e257-41d0-862b-1148d7902b79 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.606789 Dec 15 13:38:27.708007 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 479/967] 10.222.0.60 () {62 vars in 1187 bytes} [Wed Dec 15 13:38:27 2021] POST /compute/v2.1/servers => generated 402 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 15 13:38:27.718236 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-100f1bb8-c4f5-40a9-8a76-3577ced7f8e5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:27.718869 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-100f1bb8-c4f5-40a9-8a76-3577ced7f8e5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:27.773073 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-100f1bb8-c4f5-40a9-8a76-3577ced7f8e5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:27.781189 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-100f1bb8-c4f5-40a9-8a76-3577ced7f8e5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:27.783119 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-100f1bb8-c4f5-40a9-8a76-3577ced7f8e5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:27.784239 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-100f1bb8-c4f5-40a9-8a76-3577ced7f8e5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 200 len: 1281 microversion: 2.20 time: 0.070257 Dec 15 13:38:27.784807 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 489/968] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:38:27 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 1281 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:38:28.488864 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-979021c1-419e-4bdd-9bde-1bfb31d81918 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:28.489485 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-979021c1-419e-4bdd-9bde-1bfb31d81918 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] [instance: 3f40169a-0190-4f74-9297-62373f9d6d03] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:28.497023 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-979021c1-419e-4bdd-9bde-1bfb31d81918 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:28.497476 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-979021c1-419e-4bdd-9bde-1bfb31d81918 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:28.498267 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-979021c1-419e-4bdd-9bde-1bfb31d81918 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:28.499398 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-979021c1-419e-4bdd-9bde-1bfb31d81918 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:28.637472 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-979021c1-419e-4bdd-9bde-1bfb31d81918 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa1533801dc4fa0b79d8662414749d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8066a245289451b8a7cc12d4311b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:28.645003 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-979021c1-419e-4bdd-9bde-1bfb31d81918 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] 10.222.0.60 "GET /compute/v2.1/servers/3f40169a-0190-4f74-9297-62373f9d6d03" status: 200 len: 1317 microversion: 2.1 time: 0.160181 Dec 15 13:38:28.645618 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 480/969] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:28 2021] GET /compute/v2.1/servers/3f40169a-0190-4f74-9297-62373f9d6d03 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:28.801975 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-c8489be7-dcca-4050-9228-0b49ae4eda12 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:28.802591 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-c8489be7-dcca-4050-9228-0b49ae4eda12 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:28.809548 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c8489be7-dcca-4050-9228-0b49ae4eda12 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:28.809999 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c8489be7-dcca-4050-9228-0b49ae4eda12 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:28.810824 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c8489be7-dcca-4050-9228-0b49ae4eda12 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:28.811597 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c8489be7-dcca-4050-9228-0b49ae4eda12 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:28.870322 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-c8489be7-dcca-4050-9228-0b49ae4eda12 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:28.878207 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-c8489be7-dcca-4050-9228-0b49ae4eda12 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:28.879728 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-c8489be7-dcca-4050-9228-0b49ae4eda12 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:28.880821 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-c8489be7-dcca-4050-9228-0b49ae4eda12 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 200 len: 1339 microversion: 2.20 time: 0.082510 Dec 15 13:38:28.881415 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 490/970] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:38:28 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 1339 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:38:29.662750 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-67eb8282-cfd6-4280-af95-3866f3615209 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:29.663424 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-67eb8282-cfd6-4280-af95-3866f3615209 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] [instance: 3f40169a-0190-4f74-9297-62373f9d6d03] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:29.669571 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-67eb8282-cfd6-4280-af95-3866f3615209 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:29.670019 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-67eb8282-cfd6-4280-af95-3866f3615209 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:29.670796 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-67eb8282-cfd6-4280-af95-3866f3615209 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:29.671261 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-67eb8282-cfd6-4280-af95-3866f3615209 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:29.820706 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-67eb8282-cfd6-4280-af95-3866f3615209 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa1533801dc4fa0b79d8662414749d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8066a245289451b8a7cc12d4311b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:29.828504 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-67eb8282-cfd6-4280-af95-3866f3615209 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] 10.222.0.60 "GET /compute/v2.1/servers/3f40169a-0190-4f74-9297-62373f9d6d03" status: 200 len: 1317 microversion: 2.1 time: 0.169410 Dec 15 13:38:29.829080 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 481/971] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:29 2021] GET /compute/v2.1/servers/3f40169a-0190-4f74-9297-62373f9d6d03 => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:29.900647 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-da62aaff-b0db-498c-9341-f799908c938a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:29.901271 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-da62aaff-b0db-498c-9341-f799908c938a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:29.907569 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-da62aaff-b0db-498c-9341-f799908c938a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:29.908226 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-da62aaff-b0db-498c-9341-f799908c938a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:29.908972 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-da62aaff-b0db-498c-9341-f799908c938a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:29.909412 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-da62aaff-b0db-498c-9341-f799908c938a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:29.957607 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-ab3b555d-adfd-425f-989d-81d9d390ef89 req-215ca083-bdd3-4498-9dc4-40163c0bef73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6", "tag": "836e8497-8739-4936-a7da-9c197bf1d072"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:38:29.959327 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:38:29.959327 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: warnings.warn(msg) Dec 15 13:38:29.966704 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-ab3b555d-adfd-425f-989d-81d9d390ef89 req-215ca083-bdd3-4498-9dc4-40163c0bef73 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:29.967174 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-ab3b555d-adfd-425f-989d-81d9d390ef89 req-215ca083-bdd3-4498-9dc4-40163c0bef73 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:29.980261 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-ab3b555d-adfd-425f-989d-81d9d390ef89 req-215ca083-bdd3-4498-9dc4-40163c0bef73 service nova] Creating event network-changed:836e8497-8739-4936-a7da-9c197bf1d072 for instance f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 on hv-cinder-81322 Dec 15 13:38:29.986621 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-ab3b555d-adfd-425f-989d-81d9d390ef89 req-215ca083-bdd3-4498-9dc4-40163c0bef73 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035339 Dec 15 13:38:29.987686 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 482/972] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:38:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:38:30.066930 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-da62aaff-b0db-498c-9341-f799908c938a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:30.075741 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-da62aaff-b0db-498c-9341-f799908c938a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:30.077293 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-da62aaff-b0db-498c-9341-f799908c938a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:30.078426 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-da62aaff-b0db-498c-9341-f799908c938a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 200 len: 1407 microversion: 2.20 time: 0.183252 Dec 15 13:38:30.079018 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 491/973] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:38:29 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:38:30.846773 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-8fe1899e-d2d1-44ec-9cfb-f7278feb77e7 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:30.848061 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-8fe1899e-d2d1-44ec-9cfb-f7278feb77e7 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] [instance: 3f40169a-0190-4f74-9297-62373f9d6d03] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:30.854741 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8fe1899e-d2d1-44ec-9cfb-f7278feb77e7 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:30.855219 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8fe1899e-d2d1-44ec-9cfb-f7278feb77e7 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:30.856018 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8fe1899e-d2d1-44ec-9cfb-f7278feb77e7 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:30.856460 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8fe1899e-d2d1-44ec-9cfb-f7278feb77e7 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:30.986777 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-8fe1899e-d2d1-44ec-9cfb-f7278feb77e7 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa1533801dc4fa0b79d8662414749d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8066a245289451b8a7cc12d4311b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:30.994081 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-8fe1899e-d2d1-44ec-9cfb-f7278feb77e7 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] 10.222.0.60 "GET /compute/v2.1/servers/3f40169a-0190-4f74-9297-62373f9d6d03" status: 200 len: 1317 microversion: 2.1 time: 0.152419 Dec 15 13:38:30.994673 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 483/974] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:30 2021] GET /compute/v2.1/servers/3f40169a-0190-4f74-9297-62373f9d6d03 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:31.095881 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-92005077-e823-4c48-b8dd-510f0cb84ec5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:31.096503 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-92005077-e823-4c48-b8dd-510f0cb84ec5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:31.102676 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-92005077-e823-4c48-b8dd-510f0cb84ec5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:31.103156 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-92005077-e823-4c48-b8dd-510f0cb84ec5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:31.103932 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-92005077-e823-4c48-b8dd-510f0cb84ec5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:31.104366 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-92005077-e823-4c48-b8dd-510f0cb84ec5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:31.378032 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-92005077-e823-4c48-b8dd-510f0cb84ec5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:31.385605 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-92005077-e823-4c48-b8dd-510f0cb84ec5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:31.387106 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-92005077-e823-4c48-b8dd-510f0cb84ec5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:31.388206 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-92005077-e823-4c48-b8dd-510f0cb84ec5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 200 len: 1407 microversion: 2.20 time: 0.296036 Dec 15 13:38:31.388778 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 492/975] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:38:31 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 1407 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:38:32.011133 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-0d08e460-6dc7-4cd5-aebe-a82bd0b80a6a tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:32.011752 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-0d08e460-6dc7-4cd5-aebe-a82bd0b80a6a tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] [instance: 3f40169a-0190-4f74-9297-62373f9d6d03] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:32.018484 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0d08e460-6dc7-4cd5-aebe-a82bd0b80a6a tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:32.018981 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0d08e460-6dc7-4cd5-aebe-a82bd0b80a6a tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:32.019760 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0d08e460-6dc7-4cd5-aebe-a82bd0b80a6a tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:32.020202 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0d08e460-6dc7-4cd5-aebe-a82bd0b80a6a tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:32.151303 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-0d08e460-6dc7-4cd5-aebe-a82bd0b80a6a tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa1533801dc4fa0b79d8662414749d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8066a245289451b8a7cc12d4311b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:32.159194 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-0d08e460-6dc7-4cd5-aebe-a82bd0b80a6a tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] 10.222.0.60 "GET /compute/v2.1/servers/3f40169a-0190-4f74-9297-62373f9d6d03" status: 200 len: 1317 microversion: 2.1 time: 0.151731 Dec 15 13:38:32.159767 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 484/976] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:32 2021] GET /compute/v2.1/servers/3f40169a-0190-4f74-9297-62373f9d6d03 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:32.405973 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-703c8d7a-953f-4154-ae2c-ac10143f6217 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:32.406530 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-703c8d7a-953f-4154-ae2c-ac10143f6217 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:32.412849 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-703c8d7a-953f-4154-ae2c-ac10143f6217 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:32.413304 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-703c8d7a-953f-4154-ae2c-ac10143f6217 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:32.414090 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-703c8d7a-953f-4154-ae2c-ac10143f6217 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:32.414532 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-703c8d7a-953f-4154-ae2c-ac10143f6217 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:32.553539 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-703c8d7a-953f-4154-ae2c-ac10143f6217 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:32.561260 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-703c8d7a-953f-4154-ae2c-ac10143f6217 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:32.563298 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-703c8d7a-953f-4154-ae2c-ac10143f6217 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:32.564437 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-703c8d7a-953f-4154-ae2c-ac10143f6217 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 200 len: 1407 microversion: 2.20 time: 0.162787 Dec 15 13:38:32.564990 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 493/977] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:38:32 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:38:32.781331 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-bb7d69e7-4191-4099-897d-96af452a2fdc req-0b1704f9-9c0f-465a-8df4-0beea175b8e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f40169a-0190-4f74-9297-62373f9d6d03", "name": "network-vif-plugged", "status": "completed", "tag": "b276571c-8528-425e-9282-3ac695c1b993"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:38:32.782932 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:38:32.782932 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: warnings.warn(msg) Dec 15 13:38:32.790679 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-bb7d69e7-4191-4099-897d-96af452a2fdc req-0b1704f9-9c0f-465a-8df4-0beea175b8e7 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:32.790835 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-bb7d69e7-4191-4099-897d-96af452a2fdc req-0b1704f9-9c0f-465a-8df4-0beea175b8e7 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:32.802087 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-bb7d69e7-4191-4099-897d-96af452a2fdc req-0b1704f9-9c0f-465a-8df4-0beea175b8e7 service nova] Creating event network-vif-plugged:b276571c-8528-425e-9282-3ac695c1b993 for instance 3f40169a-0190-4f74-9297-62373f9d6d03 on hv-cinder-81322 Dec 15 13:38:32.806684 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-bb7d69e7-4191-4099-897d-96af452a2fdc req-0b1704f9-9c0f-465a-8df4-0beea175b8e7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028957 Dec 15 13:38:32.807331 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 485/978] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:38:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:38:33.176365 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-1bf28b74-897f-4248-92e7-33d3ded51c56 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:33.176979 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-1bf28b74-897f-4248-92e7-33d3ded51c56 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] [instance: 3f40169a-0190-4f74-9297-62373f9d6d03] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:33.183123 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1bf28b74-897f-4248-92e7-33d3ded51c56 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:33.183578 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1bf28b74-897f-4248-92e7-33d3ded51c56 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:33.184380 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1bf28b74-897f-4248-92e7-33d3ded51c56 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:33.184819 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1bf28b74-897f-4248-92e7-33d3ded51c56 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:33.312966 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-1bf28b74-897f-4248-92e7-33d3ded51c56 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa1533801dc4fa0b79d8662414749d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8066a245289451b8a7cc12d4311b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:33.319976 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-1bf28b74-897f-4248-92e7-33d3ded51c56 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] 10.222.0.60 "GET /compute/v2.1/servers/3f40169a-0190-4f74-9297-62373f9d6d03" status: 200 len: 1317 microversion: 2.1 time: 0.147301 Dec 15 13:38:33.320536 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 494/979] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:33 2021] GET /compute/v2.1/servers/3f40169a-0190-4f74-9297-62373f9d6d03 => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:38:33.583084 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-fdf84961-904e-45ed-b078-52c9251aab8f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:33.583817 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-fdf84961-904e-45ed-b078-52c9251aab8f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:33.589896 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-fdf84961-904e-45ed-b078-52c9251aab8f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:33.590351 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-fdf84961-904e-45ed-b078-52c9251aab8f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:33.591163 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-fdf84961-904e-45ed-b078-52c9251aab8f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:33.591612 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-fdf84961-904e-45ed-b078-52c9251aab8f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:33.722689 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-fdf84961-904e-45ed-b078-52c9251aab8f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:33.730446 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-fdf84961-904e-45ed-b078-52c9251aab8f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:33.731991 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-fdf84961-904e-45ed-b078-52c9251aab8f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:33.733109 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-fdf84961-904e-45ed-b078-52c9251aab8f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 200 len: 1407 microversion: 2.20 time: 0.154574 Dec 15 13:38:33.733676 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 486/980] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:38:33 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:38:34.336754 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-b07ddf4f-2239-41fb-a888-be70e2350114 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:34.337426 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-b07ddf4f-2239-41fb-a888-be70e2350114 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] [instance: 3f40169a-0190-4f74-9297-62373f9d6d03] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:34.343647 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b07ddf4f-2239-41fb-a888-be70e2350114 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:34.344087 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b07ddf4f-2239-41fb-a888-be70e2350114 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:34.344878 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b07ddf4f-2239-41fb-a888-be70e2350114 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:34.345288 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b07ddf4f-2239-41fb-a888-be70e2350114 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:34.470189 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-b07ddf4f-2239-41fb-a888-be70e2350114 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa1533801dc4fa0b79d8662414749d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8066a245289451b8a7cc12d4311b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:34.477311 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-b07ddf4f-2239-41fb-a888-be70e2350114 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] 10.222.0.60 "GET /compute/v2.1/servers/3f40169a-0190-4f74-9297-62373f9d6d03" status: 200 len: 1317 microversion: 2.1 time: 0.144188 Dec 15 13:38:34.477867 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 495/981] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:34 2021] GET /compute/v2.1/servers/3f40169a-0190-4f74-9297-62373f9d6d03 => generated 1317 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:34.750594 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-eb8ee56e-a079-42f2-b9f8-22f4052250f0 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:34.751257 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-eb8ee56e-a079-42f2-b9f8-22f4052250f0 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:34.758455 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-eb8ee56e-a079-42f2-b9f8-22f4052250f0 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:34.759396 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-eb8ee56e-a079-42f2-b9f8-22f4052250f0 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:34.760770 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-eb8ee56e-a079-42f2-b9f8-22f4052250f0 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:34.761258 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-eb8ee56e-a079-42f2-b9f8-22f4052250f0 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:34.903539 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-eb8ee56e-a079-42f2-b9f8-22f4052250f0 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:34.911732 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-eb8ee56e-a079-42f2-b9f8-22f4052250f0 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:34.913227 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-eb8ee56e-a079-42f2-b9f8-22f4052250f0 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:34.914327 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-eb8ee56e-a079-42f2-b9f8-22f4052250f0 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 200 len: 1407 microversion: 2.20 time: 0.167579 Dec 15 13:38:34.914909 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 487/982] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:38:34 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:38:35.494456 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-445795af-8f9a-402b-b1dd-08d746e4eccf tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:35.495109 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-445795af-8f9a-402b-b1dd-08d746e4eccf tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] [instance: 3f40169a-0190-4f74-9297-62373f9d6d03] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:35.501818 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-445795af-8f9a-402b-b1dd-08d746e4eccf tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:35.502266 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-445795af-8f9a-402b-b1dd-08d746e4eccf tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:35.503074 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-445795af-8f9a-402b-b1dd-08d746e4eccf tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:35.503511 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-445795af-8f9a-402b-b1dd-08d746e4eccf tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:35.628476 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-445795af-8f9a-402b-b1dd-08d746e4eccf tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa1533801dc4fa0b79d8662414749d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8066a245289451b8a7cc12d4311b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:35.635630 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-445795af-8f9a-402b-b1dd-08d746e4eccf tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] 10.222.0.60 "GET /compute/v2.1/servers/3f40169a-0190-4f74-9297-62373f9d6d03" status: 200 len: 1506 microversion: 2.1 time: 0.144792 Dec 15 13:38:35.636188 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 496/983] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:35 2021] GET /compute/v2.1/servers/3f40169a-0190-4f74-9297-62373f9d6d03 => generated 1506 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:35.652229 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-93a8342d-7fb0-4f69-99a0-a8829016788f tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b8a7d9ef-7b84-4676-ae6c-d95add6d1006", "device": "/dev/sdb"}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:38:35.653316 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-93a8342d-7fb0-4f69-99a0-a8829016788f tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] [instance: 3f40169a-0190-4f74-9297-62373f9d6d03] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:35.659565 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-93a8342d-7fb0-4f69-99a0-a8829016788f tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:35.660017 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-93a8342d-7fb0-4f69-99a0-a8829016788f tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:35.660826 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-93a8342d-7fb0-4f69-99a0-a8829016788f tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:35.661262 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-93a8342d-7fb0-4f69-99a0-a8829016788f tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:35.884390 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-93a8342d-7fb0-4f69-99a0-a8829016788f tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] 10.222.0.60 "POST /compute/v2.1/servers/3f40169a-0190-4f74-9297-62373f9d6d03/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.235734 Dec 15 13:38:35.884990 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 488/984] 10.222.0.60 () {60 vars in 1322 bytes} [Wed Dec 15 13:38:35 2021] POST /compute/v2.1/servers/3f40169a-0190-4f74-9297-62373f9d6d03/os-volume_attachments => generated 194 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:38:35.941825 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-f57ac5e8-0ee5-429b-a4f2-d0352d9e431d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:35.942516 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-f57ac5e8-0ee5-429b-a4f2-d0352d9e431d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:35.948800 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f57ac5e8-0ee5-429b-a4f2-d0352d9e431d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:35.949546 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f57ac5e8-0ee5-429b-a4f2-d0352d9e431d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:35.950382 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f57ac5e8-0ee5-429b-a4f2-d0352d9e431d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:35.950819 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f57ac5e8-0ee5-429b-a4f2-d0352d9e431d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:36.079643 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-f57ac5e8-0ee5-429b-a4f2-d0352d9e431d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:36.087333 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-f57ac5e8-0ee5-429b-a4f2-d0352d9e431d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:36.090010 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-f57ac5e8-0ee5-429b-a4f2-d0352d9e431d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:36.091167 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-f57ac5e8-0ee5-429b-a4f2-d0352d9e431d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 200 len: 1407 microversion: 2.20 time: 0.162775 Dec 15 13:38:36.091736 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 497/985] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:38:35 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:38:36.797629 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-f984280f-a467-4716-8eb9-8a81b95bdd2b req-f07db30e-543e-4fe1-b2ee-7c54259a54d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6", "name": "network-vif-plugged", "status": "completed", "tag": "836e8497-8739-4936-a7da-9c197bf1d072"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:38:36.799298 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:38:36.799298 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: warnings.warn(msg) Dec 15 13:38:36.806516 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-f984280f-a467-4716-8eb9-8a81b95bdd2b req-f07db30e-543e-4fe1-b2ee-7c54259a54d6 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:36.807001 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-f984280f-a467-4716-8eb9-8a81b95bdd2b req-f07db30e-543e-4fe1-b2ee-7c54259a54d6 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:36.817710 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-f984280f-a467-4716-8eb9-8a81b95bdd2b req-f07db30e-543e-4fe1-b2ee-7c54259a54d6 service nova] Creating event network-vif-plugged:836e8497-8739-4936-a7da-9c197bf1d072 for instance f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 on hv-cinder-81322 Dec 15 13:38:36.822384 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-f984280f-a467-4716-8eb9-8a81b95bdd2b req-f07db30e-543e-4fe1-b2ee-7c54259a54d6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029281 Dec 15 13:38:36.823173 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 489/986] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:38:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:38:37.111370 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-2d27efd5-4647-4936-823c-881b88e4d810 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:37.111370 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-2d27efd5-4647-4936-823c-881b88e4d810 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:37.119806 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2d27efd5-4647-4936-823c-881b88e4d810 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:37.120256 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2d27efd5-4647-4936-823c-881b88e4d810 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:37.121054 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2d27efd5-4647-4936-823c-881b88e4d810 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:37.121491 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2d27efd5-4647-4936-823c-881b88e4d810 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:37.256636 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-2d27efd5-4647-4936-823c-881b88e4d810 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:37.264131 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-2d27efd5-4647-4936-823c-881b88e4d810 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:37.265604 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-2d27efd5-4647-4936-823c-881b88e4d810 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:37.266751 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-2d27efd5-4647-4936-823c-881b88e4d810 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 200 len: 1407 microversion: 2.20 time: 0.160516 Dec 15 13:38:37.267367 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 498/987] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:38:37 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:38:38.286398 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-98e1c82d-8933-4730-9506-473bb242fa0a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:38.287290 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-98e1c82d-8933-4730-9506-473bb242fa0a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:38.293649 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-98e1c82d-8933-4730-9506-473bb242fa0a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:38.294134 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-98e1c82d-8933-4730-9506-473bb242fa0a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:38.294953 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-98e1c82d-8933-4730-9506-473bb242fa0a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:38.295396 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-98e1c82d-8933-4730-9506-473bb242fa0a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:38.423010 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-98e1c82d-8933-4730-9506-473bb242fa0a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:38.430591 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-98e1c82d-8933-4730-9506-473bb242fa0a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:38.432108 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-98e1c82d-8933-4730-9506-473bb242fa0a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:38.433199 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-98e1c82d-8933-4730-9506-473bb242fa0a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 200 len: 1407 microversion: 2.20 time: 0.152392 Dec 15 13:38:38.433756 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 490/988] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:38:38 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:38:39.451037 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-4881568f-79c5-43eb-bebe-ae5834de944f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:39.451586 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-4881568f-79c5-43eb-bebe-ae5834de944f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:39.458251 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4881568f-79c5-43eb-bebe-ae5834de944f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:39.458703 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4881568f-79c5-43eb-bebe-ae5834de944f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:39.459524 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4881568f-79c5-43eb-bebe-ae5834de944f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:39.459959 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4881568f-79c5-43eb-bebe-ae5834de944f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:39.589746 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-4881568f-79c5-43eb-bebe-ae5834de944f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:39.598085 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-4881568f-79c5-43eb-bebe-ae5834de944f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:39.599605 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-4881568f-79c5-43eb-bebe-ae5834de944f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:39.600754 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-4881568f-79c5-43eb-bebe-ae5834de944f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 200 len: 1600 microversion: 2.20 time: 0.154138 Dec 15 13:38:39.601308 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 499/989] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:38:39 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:38:39.618009 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-2a73b62e-5255-47da-902a-446ada5f1873 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:39.618541 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-2a73b62e-5255-47da-902a-446ada5f1873 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:39.624669 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2a73b62e-5255-47da-902a-446ada5f1873 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:39.625125 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2a73b62e-5255-47da-902a-446ada5f1873 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:39.625911 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2a73b62e-5255-47da-902a-446ada5f1873 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:39.626380 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2a73b62e-5255-47da-902a-446ada5f1873 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:39.704096 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-2a73b62e-5255-47da-902a-446ada5f1873 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.089771 Dec 15 13:38:39.705234 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 491/990] 10.222.0.60 () {60 vars in 1315 bytes} [Wed Dec 15 13:38:39 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:38:40.832422 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-06d5b87d-b988-43b0-a946-ceaeee9932e4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:38:40.833282 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-06d5b87d-b988-43b0-a946-ceaeee9932e4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:40.837513 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-c83eaed0-4eee-4b1a-8044-446b05fbc132 req-43841006-2e2e-4f1c-aa71-076425e132e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6", "tag": "836e8497-8739-4936-a7da-9c197bf1d072"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:38:40.839035 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:38:40.839035 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: warnings.warn(msg) Dec 15 13:38:40.839759 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-06d5b87d-b988-43b0-a946-ceaeee9932e4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:40.840208 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-06d5b87d-b988-43b0-a946-ceaeee9932e4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:40.841261 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-06d5b87d-b988-43b0-a946-ceaeee9932e4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:40.841901 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-06d5b87d-b988-43b0-a946-ceaeee9932e4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:40.845945 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-c83eaed0-4eee-4b1a-8044-446b05fbc132 req-43841006-2e2e-4f1c-aa71-076425e132e2 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:40.846400 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-c83eaed0-4eee-4b1a-8044-446b05fbc132 req-43841006-2e2e-4f1c-aa71-076425e132e2 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:40.857688 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-c83eaed0-4eee-4b1a-8044-446b05fbc132 req-43841006-2e2e-4f1c-aa71-076425e132e2 service nova] Creating event network-changed:836e8497-8739-4936-a7da-9c197bf1d072 for instance f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 on hv-cinder-81322 Dec 15 13:38:40.863078 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-c83eaed0-4eee-4b1a-8044-446b05fbc132 req-43841006-2e2e-4f1c-aa71-076425e132e2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029512 Dec 15 13:38:40.863861 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 492/991] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:38:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:38:40.909739 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-06d5b87d-b988-43b0-a946-ceaeee9932e4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 14 microversion: 2.20 time: 0.081491 Dec 15 13:38:40.910678 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 500/992] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:38:40 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:41.922064 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-f7ad9677-111d-4767-8515-1f0f3f45a061 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:38:41.923140 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-f7ad9677-111d-4767-8515-1f0f3f45a061 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:41.929276 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f7ad9677-111d-4767-8515-1f0f3f45a061 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:41.929735 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f7ad9677-111d-4767-8515-1f0f3f45a061 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:41.930515 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f7ad9677-111d-4767-8515-1f0f3f45a061 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:41.930981 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f7ad9677-111d-4767-8515-1f0f3f45a061 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:42.025273 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-f7ad9677-111d-4767-8515-1f0f3f45a061 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 14 microversion: 2.20 time: 0.107697 Dec 15 13:38:42.025919 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 493/993] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:38:41 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:43.037015 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-188dbfaa-b1f1-41d4-ae7a-6fcedee94e54 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:38:43.038001 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-188dbfaa-b1f1-41d4-ae7a-6fcedee94e54 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:43.044756 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-188dbfaa-b1f1-41d4-ae7a-6fcedee94e54 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:43.045208 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-188dbfaa-b1f1-41d4-ae7a-6fcedee94e54 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:43.045980 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-188dbfaa-b1f1-41d4-ae7a-6fcedee94e54 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:43.046414 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-188dbfaa-b1f1-41d4-ae7a-6fcedee94e54 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:43.136814 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-188dbfaa-b1f1-41d4-ae7a-6fcedee94e54 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 14 microversion: 2.20 time: 0.104104 Dec 15 13:38:43.137344 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 501/994] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:38:43 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:38:44.147822 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-5d205435-5c58-4c28-b926-673905f9b63a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:38:44.148818 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-5d205435-5c58-4c28-b926-673905f9b63a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:44.155840 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5d205435-5c58-4c28-b926-673905f9b63a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:44.156296 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5d205435-5c58-4c28-b926-673905f9b63a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:44.157070 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5d205435-5c58-4c28-b926-673905f9b63a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:44.157502 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5d205435-5c58-4c28-b926-673905f9b63a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:48.284834 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-5d205435-5c58-4c28-b926-673905f9b63a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 14 microversion: 2.20 time: 4.140835 Dec 15 13:38:48.285501 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 494/995] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:38:44 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 14 bytes in 4143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:49.296381 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ea65c65e-e110-428a-ac99-e0b985ce6daf tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:38:49.297468 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ea65c65e-e110-428a-ac99-e0b985ce6daf tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:49.304286 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ea65c65e-e110-428a-ac99-e0b985ce6daf tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:49.304739 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ea65c65e-e110-428a-ac99-e0b985ce6daf tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:49.305524 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ea65c65e-e110-428a-ac99-e0b985ce6daf tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:49.305963 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ea65c65e-e110-428a-ac99-e0b985ce6daf tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:49.377634 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ea65c65e-e110-428a-ac99-e0b985ce6daf tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 14 microversion: 2.20 time: 0.085253 Dec 15 13:38:49.378297 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 502/996] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:38:49 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:50.389142 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-2e3ef528-70b8-4336-98d8-32aa69a2f9a1 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:38:50.390151 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-2e3ef528-70b8-4336-98d8-32aa69a2f9a1 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:50.397035 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2e3ef528-70b8-4336-98d8-32aa69a2f9a1 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:50.397487 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2e3ef528-70b8-4336-98d8-32aa69a2f9a1 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:50.398271 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2e3ef528-70b8-4336-98d8-32aa69a2f9a1 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:50.398708 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-2e3ef528-70b8-4336-98d8-32aa69a2f9a1 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:53.987371 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-2e3ef528-70b8-4336-98d8-32aa69a2f9a1 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 18356 microversion: 2.20 time: 3.602144 Dec 15 13:38:53.988239 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 495/997] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:38:50 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 18356 bytes in 3604 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:38:54.999262 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-c850d838-9336-4f8e-9664-868dd27a75ba tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:38:55.000252 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-c850d838-9336-4f8e-9664-868dd27a75ba tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:55.007004 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c850d838-9336-4f8e-9664-868dd27a75ba tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:55.007457 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c850d838-9336-4f8e-9664-868dd27a75ba tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:55.008236 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c850d838-9336-4f8e-9664-868dd27a75ba tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:55.008673 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c850d838-9336-4f8e-9664-868dd27a75ba tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:55.079190 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-c850d838-9336-4f8e-9664-868dd27a75ba tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 19133 microversion: 2.20 time: 0.083826 Dec 15 13:38:55.079826 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 503/998] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:38:54 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 19133 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:38:56.090230 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-565697e2-d76e-4aba-b60b-8c928eb97525 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:38:56.091260 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-565697e2-d76e-4aba-b60b-8c928eb97525 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:56.098964 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-565697e2-d76e-4aba-b60b-8c928eb97525 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:56.099400 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-565697e2-d76e-4aba-b60b-8c928eb97525 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:56.100172 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-565697e2-d76e-4aba-b60b-8c928eb97525 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:56.100610 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-565697e2-d76e-4aba-b60b-8c928eb97525 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:56.181048 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-565697e2-d76e-4aba-b60b-8c928eb97525 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 21282 microversion: 2.20 time: 0.094682 Dec 15 13:38:56.181894 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 496/999] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:38:56 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 21282 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:38:57.193312 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-d99049f9-02c9-46b5-a41c-6c558c349adb tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:38:57.194323 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-d99049f9-02c9-46b5-a41c-6c558c349adb tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:57.201438 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d99049f9-02c9-46b5-a41c-6c558c349adb tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:57.201895 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d99049f9-02c9-46b5-a41c-6c558c349adb tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:57.202681 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d99049f9-02c9-46b5-a41c-6c558c349adb tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:57.203157 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d99049f9-02c9-46b5-a41c-6c558c349adb tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:57.279311 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-d99049f9-02c9-46b5-a41c-6c558c349adb tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 22975 microversion: 2.20 time: 0.090410 Dec 15 13:38:57.279929 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 504/1000] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:38:57 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 22975 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:38:58.170622 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-9f671f67-cc96-4a5b-b063-b7456b07d1bb tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:58.171250 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-9f671f67-cc96-4a5b-b063-b7456b07d1bb tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] [instance: 3f40169a-0190-4f74-9297-62373f9d6d03] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:58.178741 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9f671f67-cc96-4a5b-b063-b7456b07d1bb tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:58.179218 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9f671f67-cc96-4a5b-b063-b7456b07d1bb tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:58.180001 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9f671f67-cc96-4a5b-b063-b7456b07d1bb tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:58.180443 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9f671f67-cc96-4a5b-b063-b7456b07d1bb tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:58.255826 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.objects.instance [None req-9f671f67-cc96-4a5b-b063-b7456b07d1bb tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lazy-loading 'services' on Instance uuid 3f40169a-0190-4f74-9297-62373f9d6d03 {{(pid=116941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:38:58.291691 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-8f670851-9036-4634-b28a-c1e1ee51acd6 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:38:58.292697 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-8f670851-9036-4634-b28a-c1e1ee51acd6 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:58.299475 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8f670851-9036-4634-b28a-c1e1ee51acd6 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:58.300120 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8f670851-9036-4634-b28a-c1e1ee51acd6 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:58.300814 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8f670851-9036-4634-b28a-c1e1ee51acd6 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:58.301257 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8f670851-9036-4634-b28a-c1e1ee51acd6 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:58.325840 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-9f671f67-cc96-4a5b-b063-b7456b07d1bb tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3f40169a-0190-4f74-9297-62373f9d6d03/os-volume_attachments/b8a7d9ef-7b84-4676-ae6c-d95add6d1006" status: 202 len: 0 microversion: 2.1 time: 0.158905 Dec 15 13:38:58.326695 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 497/1001] 10.222.0.60 () {58 vars in 1415 bytes} [Wed Dec 15 13:38:58 2021] DELETE /compute/v2.1/servers/3f40169a-0190-4f74-9297-62373f9d6d03/os-volume_attachments/b8a7d9ef-7b84-4676-ae6c-d95add6d1006 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:38:58.386159 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-8f670851-9036-4634-b28a-c1e1ee51acd6 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 24316 microversion: 2.20 time: 0.098361 Dec 15 13:38:58.386860 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 505/1002] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:38:58 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 24316 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:38:59.398245 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-cfb02bc8-d7de-442b-9d0f-b29628b82441 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:38:59.399327 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-cfb02bc8-d7de-442b-9d0f-b29628b82441 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:59.405403 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cfb02bc8-d7de-442b-9d0f-b29628b82441 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:59.405862 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cfb02bc8-d7de-442b-9d0f-b29628b82441 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:59.406639 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cfb02bc8-d7de-442b-9d0f-b29628b82441 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:59.407109 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cfb02bc8-d7de-442b-9d0f-b29628b82441 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:59.432423 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-d1efac4d-c777-4097-a55f-bd47c529fc3b tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:59.433011 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-d1efac4d-c777-4097-a55f-bd47c529fc3b tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] [instance: 3f40169a-0190-4f74-9297-62373f9d6d03] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:59.440050 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d1efac4d-c777-4097-a55f-bd47c529fc3b tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:59.440585 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d1efac4d-c777-4097-a55f-bd47c529fc3b tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:59.441352 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d1efac4d-c777-4097-a55f-bd47c529fc3b tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:59.441787 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d1efac4d-c777-4097-a55f-bd47c529fc3b tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:59.466080 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-d1efac4d-c777-4097-a55f-bd47c529fc3b tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] [instance: 3f40169a-0190-4f74-9297-62373f9d6d03] Going to try to terminate instance {{(pid=116942) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:38:59.495918 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-cfb02bc8-d7de-442b-9d0f-b29628b82441 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 25431 microversion: 2.20 time: 0.101938 Dec 15 13:38:59.499861 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 498/1003] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:38:59 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 25431 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:38:59.538111 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-d1efac4d-c777-4097-a55f-bd47c529fc3b tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3f40169a-0190-4f74-9297-62373f9d6d03" status: 204 len: 0 microversion: 2.1 time: 0.109300 Dec 15 13:38:59.538700 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 506/1004] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Dec 15 13:38:59 2021] DELETE /compute/v2.1/servers/3f40169a-0190-4f74-9297-62373f9d6d03 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 15 13:38:59.547499 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-60336bb9-56a4-4c60-a662-7cb25771568c tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:59.548207 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-60336bb9-56a4-4c60-a662-7cb25771568c tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] [instance: 3f40169a-0190-4f74-9297-62373f9d6d03] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:59.555597 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-60336bb9-56a4-4c60-a662-7cb25771568c tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:59.556049 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-60336bb9-56a4-4c60-a662-7cb25771568c tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:59.556829 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-60336bb9-56a4-4c60-a662-7cb25771568c tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:59.557267 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-60336bb9-56a4-4c60-a662-7cb25771568c tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:59.685780 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-60336bb9-56a4-4c60-a662-7cb25771568c tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa1533801dc4fa0b79d8662414749d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8066a245289451b8a7cc12d4311b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:59.694452 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-60336bb9-56a4-4c60-a662-7cb25771568c tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] 10.222.0.60 "GET /compute/v2.1/servers/3f40169a-0190-4f74-9297-62373f9d6d03" status: 200 len: 1512 microversion: 2.1 time: 0.151033 Dec 15 13:38:59.695060 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 499/1005] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:59 2021] GET /compute/v2.1/servers/3f40169a-0190-4f74-9297-62373f9d6d03 => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:39:00.508616 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-0240b28c-1402-4346-94b4-91bd7502d623 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:00.509610 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-0240b28c-1402-4346-94b4-91bd7502d623 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:00.515750 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0240b28c-1402-4346-94b4-91bd7502d623 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:00.516202 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0240b28c-1402-4346-94b4-91bd7502d623 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:00.517020 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0240b28c-1402-4346-94b4-91bd7502d623 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:00.517453 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0240b28c-1402-4346-94b4-91bd7502d623 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:00.593112 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-0240b28c-1402-4346-94b4-91bd7502d623 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 26538 microversion: 2.20 time: 0.088475 Dec 15 13:39:00.593748 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 507/1006] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:39:00 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 26538 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:39:00.711006 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-4205e0ad-d85a-4834-8b08-f2c8a1124763 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:00.711622 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-4205e0ad-d85a-4834-8b08-f2c8a1124763 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] [instance: 3f40169a-0190-4f74-9297-62373f9d6d03] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:00.717848 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4205e0ad-d85a-4834-8b08-f2c8a1124763 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:00.718293 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4205e0ad-d85a-4834-8b08-f2c8a1124763 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:00.719109 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4205e0ad-d85a-4834-8b08-f2c8a1124763 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:00.719546 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4205e0ad-d85a-4834-8b08-f2c8a1124763 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:00.854965 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-4205e0ad-d85a-4834-8b08-f2c8a1124763 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa1533801dc4fa0b79d8662414749d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8066a245289451b8a7cc12d4311b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:00.862199 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-4205e0ad-d85a-4834-8b08-f2c8a1124763 tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] 10.222.0.60 "GET /compute/v2.1/servers/3f40169a-0190-4f74-9297-62373f9d6d03" status: 200 len: 1512 microversion: 2.1 time: 0.154943 Dec 15 13:39:00.863353 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 500/1007] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:00 2021] GET /compute/v2.1/servers/3f40169a-0190-4f74-9297-62373f9d6d03 => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:01.605156 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-46277c7b-f8d2-45f7-8d16-6f47779371b8 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:01.606192 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-46277c7b-f8d2-45f7-8d16-6f47779371b8 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:01.612976 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-46277c7b-f8d2-45f7-8d16-6f47779371b8 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:01.613435 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-46277c7b-f8d2-45f7-8d16-6f47779371b8 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:01.614214 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-46277c7b-f8d2-45f7-8d16-6f47779371b8 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:01.614654 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-46277c7b-f8d2-45f7-8d16-6f47779371b8 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:01.689717 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-46277c7b-f8d2-45f7-8d16-6f47779371b8 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 27202 microversion: 2.20 time: 0.088516 Dec 15 13:39:01.691783 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 508/1008] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:39:01 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 27202 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:39:01.880174 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-674410d6-80d1-4de4-9aa9-7985e35e8c9a tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:01.880794 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-674410d6-80d1-4de4-9aa9-7985e35e8c9a tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] [instance: 3f40169a-0190-4f74-9297-62373f9d6d03] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:01.887106 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-674410d6-80d1-4de4-9aa9-7985e35e8c9a tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:01.887565 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-674410d6-80d1-4de4-9aa9-7985e35e8c9a tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:01.888361 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-674410d6-80d1-4de4-9aa9-7985e35e8c9a tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:01.888802 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-674410d6-80d1-4de4-9aa9-7985e35e8c9a tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:02.019398 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-674410d6-80d1-4de4-9aa9-7985e35e8c9a tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa1533801dc4fa0b79d8662414749d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8066a245289451b8a7cc12d4311b412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:02.026733 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-674410d6-80d1-4de4-9aa9-7985e35e8c9a tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] 10.222.0.60 "GET /compute/v2.1/servers/3f40169a-0190-4f74-9297-62373f9d6d03" status: 200 len: 1512 microversion: 2.1 time: 0.150796 Dec 15 13:39:02.027390 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 501/1009] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:01 2021] GET /compute/v2.1/servers/3f40169a-0190-4f74-9297-62373f9d6d03 => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:02.192794 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-0820f063-be32-4729-bd1f-5692be83bfac req-942cf509-4ca8-4f3b-b5bc-dfb570344e68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f40169a-0190-4f74-9297-62373f9d6d03", "name": "network-vif-deleted", "tag": "b276571c-8528-425e-9282-3ac695c1b993"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:02.194540 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:39:02.194540 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: warnings.warn(msg) Dec 15 13:39:02.204641 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-0820f063-be32-4729-bd1f-5692be83bfac req-942cf509-4ca8-4f3b-b5bc-dfb570344e68 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:02.205095 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-0820f063-be32-4729-bd1f-5692be83bfac req-942cf509-4ca8-4f3b-b5bc-dfb570344e68 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:02.217548 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-0820f063-be32-4729-bd1f-5692be83bfac req-942cf509-4ca8-4f3b-b5bc-dfb570344e68 service nova] Creating event network-vif-deleted:b276571c-8528-425e-9282-3ac695c1b993 for instance 3f40169a-0190-4f74-9297-62373f9d6d03 on hv-cinder-81322 Dec 15 13:39:02.222531 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-0820f063-be32-4729-bd1f-5692be83bfac req-942cf509-4ca8-4f3b-b5bc-dfb570344e68 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034575 Dec 15 13:39:02.223159 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 509/1010] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:39:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:39:02.701839 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-f7726ffa-bc85-4907-b1b6-c0b1504b8708 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:02.702783 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-f7726ffa-bc85-4907-b1b6-c0b1504b8708 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:02.708855 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f7726ffa-bc85-4907-b1b6-c0b1504b8708 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:02.709305 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f7726ffa-bc85-4907-b1b6-c0b1504b8708 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:02.710083 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f7726ffa-bc85-4907-b1b6-c0b1504b8708 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:02.710516 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f7726ffa-bc85-4907-b1b6-c0b1504b8708 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:02.787098 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-f7726ffa-bc85-4907-b1b6-c0b1504b8708 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 27723 microversion: 2.20 time: 0.089099 Dec 15 13:39:02.787973 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 502/1011] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:39:02 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 27723 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:39:03.044252 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-a51c77ce-bb32-4e71-aec4-0f2dd738987e tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:03.044960 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-a51c77ce-bb32-4e71-aec4-0f2dd738987e tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] [instance: 3f40169a-0190-4f74-9297-62373f9d6d03] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:03.052048 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a51c77ce-bb32-4e71-aec4-0f2dd738987e tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:03.052505 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a51c77ce-bb32-4e71-aec4-0f2dd738987e tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:03.053299 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a51c77ce-bb32-4e71-aec4-0f2dd738987e tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:03.053746 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a51c77ce-bb32-4e71-aec4-0f2dd738987e tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:03.066714 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.wsgi [None req-a51c77ce-bb32-4e71-aec4-0f2dd738987e tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] HTTP exception thrown: Instance 3f40169a-0190-4f74-9297-62373f9d6d03 could not be found. Dec 15 13:39:03.067335 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-a51c77ce-bb32-4e71-aec4-0f2dd738987e tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] Returning 404 to user: Instance 3f40169a-0190-4f74-9297-62373f9d6d03 could not be found. {{(pid=116942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:39:03.068156 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-a51c77ce-bb32-4e71-aec4-0f2dd738987e tempest-VolumesSnapshotTestJSON-1951480776 tempest-VolumesSnapshotTestJSON-1951480776-project] 10.222.0.60 "GET /compute/v2.1/servers/3f40169a-0190-4f74-9297-62373f9d6d03" status: 404 len: 111 microversion: 2.1 time: 0.027942 Dec 15 13:39:03.069225 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 510/1012] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:03 2021] GET /compute/v2.1/servers/3f40169a-0190-4f74-9297-62373f9d6d03 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:39:03.799250 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-9169dffe-cd66-4463-9035-24331306631b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:03.800261 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-9169dffe-cd66-4463-9035-24331306631b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:03.807088 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9169dffe-cd66-4463-9035-24331306631b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:03.807545 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9169dffe-cd66-4463-9035-24331306631b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:03.808329 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9169dffe-cd66-4463-9035-24331306631b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:03.808799 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9169dffe-cd66-4463-9035-24331306631b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:03.888420 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-9169dffe-cd66-4463-9035-24331306631b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 28101 microversion: 2.20 time: 0.093087 Dec 15 13:39:03.889045 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 503/1013] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:39:03 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 28101 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:39:04.899980 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-06bbda7a-10e1-4f20-8e26-785f76069af8 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:04.900885 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-06bbda7a-10e1-4f20-8e26-785f76069af8 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:04.907099 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-06bbda7a-10e1-4f20-8e26-785f76069af8 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:04.907559 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-06bbda7a-10e1-4f20-8e26-785f76069af8 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:04.908338 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-06bbda7a-10e1-4f20-8e26-785f76069af8 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:04.908780 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-06bbda7a-10e1-4f20-8e26-785f76069af8 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:05.342587 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-06bbda7a-10e1-4f20-8e26-785f76069af8 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 28194 microversion: 2.20 time: 0.446172 Dec 15 13:39:05.343286 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 511/1014] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:39:04 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 28194 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:39:06.354488 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-22586902-13ff-4c33-abf5-3eb04ea09302 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:06.355514 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-22586902-13ff-4c33-abf5-3eb04ea09302 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:06.362406 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-22586902-13ff-4c33-abf5-3eb04ea09302 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:06.363474 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-22586902-13ff-4c33-abf5-3eb04ea09302 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:06.364261 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-22586902-13ff-4c33-abf5-3eb04ea09302 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:06.364700 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-22586902-13ff-4c33-abf5-3eb04ea09302 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:09.093586 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-22586902-13ff-4c33-abf5-3eb04ea09302 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 28194 microversion: 2.20 time: 2.742903 Dec 15 13:39:09.098174 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 504/1015] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:39:06 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 28194 bytes in 2745 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:39:09.910031 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-33b03ec2-fad0-4b1c-91cf-7a24ec3fd052 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:09.911066 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-33b03ec2-fad0-4b1c-91cf-7a24ec3fd052 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:09.918080 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-33b03ec2-fad0-4b1c-91cf-7a24ec3fd052 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:09.918542 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-33b03ec2-fad0-4b1c-91cf-7a24ec3fd052 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:09.919364 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-33b03ec2-fad0-4b1c-91cf-7a24ec3fd052 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:09.919808 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-33b03ec2-fad0-4b1c-91cf-7a24ec3fd052 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:09.952744 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-33b03ec2-fad0-4b1c-91cf-7a24ec3fd052 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046820 Dec 15 13:39:09.953316 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 512/1016] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Dec 15 13:39:09 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:39:10.010202 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-3fce57f7-6499-4d9b-8bdb-df3e58bb6da6 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:10.010784 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-3fce57f7-6499-4d9b-8bdb-df3e58bb6da6 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:10.018222 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3fce57f7-6499-4d9b-8bdb-df3e58bb6da6 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:10.018671 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3fce57f7-6499-4d9b-8bdb-df3e58bb6da6 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:10.020173 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3fce57f7-6499-4d9b-8bdb-df3e58bb6da6 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:10.020592 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3fce57f7-6499-4d9b-8bdb-df3e58bb6da6 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:10.044209 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-3fce57f7-6499-4d9b-8bdb-df3e58bb6da6 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Going to try to terminate instance {{(pid=116941) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:39:10.106351 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-0211fa67-dacc-49aa-b773-b7cb9dfaf23d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:10.107282 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-0211fa67-dacc-49aa-b773-b7cb9dfaf23d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:10.113781 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0211fa67-dacc-49aa-b773-b7cb9dfaf23d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:10.114241 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0211fa67-dacc-49aa-b773-b7cb9dfaf23d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:10.115072 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0211fa67-dacc-49aa-b773-b7cb9dfaf23d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:10.115516 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0211fa67-dacc-49aa-b773-b7cb9dfaf23d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:10.125895 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-3fce57f7-6499-4d9b-8bdb-df3e58bb6da6 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 204 len: 0 microversion: 2.1 time: 0.119316 Dec 15 13:39:10.127024 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 505/1017] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Dec 15 13:39:10 2021] DELETE /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:39:10.135791 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-83a6e1b4-5e6f-4600-894c-34b55b701884 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:10.136500 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-83a6e1b4-5e6f-4600-894c-34b55b701884 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:10.142459 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-83a6e1b4-5e6f-4600-894c-34b55b701884 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:10.142999 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-83a6e1b4-5e6f-4600-894c-34b55b701884 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:10.143865 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-83a6e1b4-5e6f-4600-894c-34b55b701884 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:10.144896 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-83a6e1b4-5e6f-4600-894c-34b55b701884 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:10.178772 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-0211fa67-dacc-49aa-b773-b7cb9dfaf23d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 28194 microversion: 2.20 time: 0.076096 Dec 15 13:39:10.179688 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 513/1018] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:39:10 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 28194 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:39:10.274116 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-83a6e1b4-5e6f-4600-894c-34b55b701884 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:10.281303 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-83a6e1b4-5e6f-4600-894c-34b55b701884 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1674 microversion: 2.1 time: 0.149459 Dec 15 13:39:10.281903 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 506/1019] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:10 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:11.190543 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-aa675c02-bec4-4ae5-b055-2cd04e724b20 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:11.192169 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-aa675c02-bec4-4ae5-b055-2cd04e724b20 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:11.198898 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-aa675c02-bec4-4ae5-b055-2cd04e724b20 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:11.199362 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-aa675c02-bec4-4ae5-b055-2cd04e724b20 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:11.200165 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-aa675c02-bec4-4ae5-b055-2cd04e724b20 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:11.200602 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-aa675c02-bec4-4ae5-b055-2cd04e724b20 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:11.261950 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-aa675c02-bec4-4ae5-b055-2cd04e724b20 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 28194 microversion: 2.20 time: 0.075431 Dec 15 13:39:11.262576 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 514/1020] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:39:11 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 28194 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:39:11.298417 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-1d187578-61ea-4404-bd96-683e216cb738 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:11.299332 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-1d187578-61ea-4404-bd96-683e216cb738 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:11.309867 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1d187578-61ea-4404-bd96-683e216cb738 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:11.310688 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1d187578-61ea-4404-bd96-683e216cb738 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:11.311882 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1d187578-61ea-4404-bd96-683e216cb738 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:11.312325 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1d187578-61ea-4404-bd96-683e216cb738 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:11.452035 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-1d187578-61ea-4404-bd96-683e216cb738 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:11.459420 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-1d187578-61ea-4404-bd96-683e216cb738 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1674 microversion: 2.1 time: 0.164804 Dec 15 13:39:11.460006 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 507/1021] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:11 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1674 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:12.275014 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-80caebcb-a6bc-49d1-9e7d-35c19e708277 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:12.276987 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-80caebcb-a6bc-49d1-9e7d-35c19e708277 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:12.284959 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-80caebcb-a6bc-49d1-9e7d-35c19e708277 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:12.285546 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-80caebcb-a6bc-49d1-9e7d-35c19e708277 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:12.286395 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-80caebcb-a6bc-49d1-9e7d-35c19e708277 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:12.286831 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-80caebcb-a6bc-49d1-9e7d-35c19e708277 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:12.367689 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-80caebcb-a6bc-49d1-9e7d-35c19e708277 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 28194 microversion: 2.20 time: 0.096634 Dec 15 13:39:12.372222 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 515/1022] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:39:12 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 28194 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:39:12.477996 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-15fd7362-cad5-4438-a575-c8d814869f74 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:12.478857 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-15fd7362-cad5-4438-a575-c8d814869f74 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:12.486810 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-4d8df99b-84e7-486a-8be2-da216124d889 req-930c2a18-bb7f-482b-9040-4c0520c7dfec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef0157ed-5d02-45a9-9160-55cc033a16ec", "name": "network-vif-deleted", "tag": "745293fa-0314-47a0-bb77-7fceb3a9fc17"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:12.490144 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:39:12.490144 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: warnings.warn(msg) Dec 15 13:39:12.494757 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-15fd7362-cad5-4438-a575-c8d814869f74 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:12.495949 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-15fd7362-cad5-4438-a575-c8d814869f74 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:12.496808 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-15fd7362-cad5-4438-a575-c8d814869f74 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:12.497258 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-15fd7362-cad5-4438-a575-c8d814869f74 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:12.511483 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-4d8df99b-84e7-486a-8be2-da216124d889 req-930c2a18-bb7f-482b-9040-4c0520c7dfec service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:12.512632 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-4d8df99b-84e7-486a-8be2-da216124d889 req-930c2a18-bb7f-482b-9040-4c0520c7dfec service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:12.527344 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-4d8df99b-84e7-486a-8be2-da216124d889 req-930c2a18-bb7f-482b-9040-4c0520c7dfec service nova] Creating event network-vif-deleted:745293fa-0314-47a0-bb77-7fceb3a9fc17 for instance ef0157ed-5d02-45a9-9160-55cc033a16ec on hv-cinder-81322 Dec 15 13:39:12.532948 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-4d8df99b-84e7-486a-8be2-da216124d889 req-930c2a18-bb7f-482b-9040-4c0520c7dfec service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050911 Dec 15 13:39:12.533694 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 516/1023] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:39:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:39:12.589893 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-15fd7362-cad5-4438-a575-c8d814869f74 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:12.602549 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-15fd7362-cad5-4438-a575-c8d814869f74 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 200 len: 1606 microversion: 2.1 time: 0.128830 Dec 15 13:39:12.603565 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 508/1024] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:12 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 1606 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:13.380693 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-dd48309b-32be-4b3c-8c4a-446b449e6c41 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:13.381707 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-dd48309b-32be-4b3c-8c4a-446b449e6c41 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:13.387830 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-dd48309b-32be-4b3c-8c4a-446b449e6c41 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:13.388289 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-dd48309b-32be-4b3c-8c4a-446b449e6c41 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:13.389087 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-dd48309b-32be-4b3c-8c4a-446b449e6c41 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:13.389531 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-dd48309b-32be-4b3c-8c4a-446b449e6c41 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:13.453103 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-dd48309b-32be-4b3c-8c4a-446b449e6c41 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 28194 microversion: 2.20 time: 0.076726 Dec 15 13:39:13.457682 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 517/1025] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:39:13 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 28194 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:39:13.622430 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-ea65f5ba-4b45-4e4c-b1f9-7e45f8d96512 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:13.623115 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-ea65f5ba-4b45-4e4c-b1f9-7e45f8d96512 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:13.629702 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ea65f5ba-4b45-4e4c-b1f9-7e45f8d96512 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:13.630185 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ea65f5ba-4b45-4e4c-b1f9-7e45f8d96512 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:13.631183 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ea65f5ba-4b45-4e4c-b1f9-7e45f8d96512 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:13.631717 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ea65f5ba-4b45-4e4c-b1f9-7e45f8d96512 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:13.645792 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.wsgi [None req-ea65f5ba-4b45-4e4c-b1f9-7e45f8d96512 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] HTTP exception thrown: Instance ef0157ed-5d02-45a9-9160-55cc033a16ec could not be found. Dec 15 13:39:13.646434 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-ea65f5ba-4b45-4e4c-b1f9-7e45f8d96512 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Returning 404 to user: Instance ef0157ed-5d02-45a9-9160-55cc033a16ec could not be found. {{(pid=116941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:39:13.648512 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-ea65f5ba-4b45-4e4c-b1f9-7e45f8d96512 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 404 len: 111 microversion: 2.1 time: 0.028517 Dec 15 13:39:13.648512 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 509/1026] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:13 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:39:13.656841 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-8dfc9844-4454-4946-8743-4a56abb5a213 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '.version_select at 0x7ff50f4f0d30>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:13.673835 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-8dfc9844-4454-4946-8743-4a56abb5a213 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1233220904" status: 202 len: 0 microversion: 2.1 time: 0.021225 Dec 15 13:39:13.674540 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 518/1027] 10.222.0.60 () {58 vars in 1220 bytes} [Wed Dec 15 13:39:13 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1233220904 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:39:14.313300 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-b6c19220-828f-4710-a5d4-a5fb070a3c48 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'create', calling method: .version_select at 0x7ff50f4f43a0>, body: {"keypair": {"name": "tempest-keypair-467884376"}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:14.327806 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-b6c19220-828f-4710-a5d4-a5fb070a3c48 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Getting quotas for project 4cde9c0e34334ad7a7e79bfeb8963935. Resources: {'key_pairs'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:39:14.331561 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-b6c19220-828f-4710-a5d4-a5fb070a3c48 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Getting quotas for user e2f51c315df74089bc6873e889cf80d7 and project 4cde9c0e34334ad7a7e79bfeb8963935. Resources: {'key_pairs'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:39:14.457121 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-b6c19220-828f-4710-a5d4-a5fb070a3c48 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Getting quotas for project 4cde9c0e34334ad7a7e79bfeb8963935. Resources: {'key_pairs'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:39:14.460855 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-b6c19220-828f-4710-a5d4-a5fb070a3c48 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Getting quotas for user e2f51c315df74089bc6873e889cf80d7 and project 4cde9c0e34334ad7a7e79bfeb8963935. Resources: {'key_pairs'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:39:14.465717 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-7ca07fff-b596-489d-91d6-04619ad62257 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:14.467357 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-7ca07fff-b596-489d-91d6-04619ad62257 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:14.473767 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7ca07fff-b596-489d-91d6-04619ad62257 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:14.473978 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-b6c19220-828f-4710-a5d4-a5fb070a3c48 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.164435 Dec 15 13:39:14.474224 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7ca07fff-b596-489d-91d6-04619ad62257 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:14.474583 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 510/1028] 10.222.0.60 () {60 vars in 1157 bytes} [Wed Dec 15 13:39:14 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:39:14.475660 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7ca07fff-b596-489d-91d6-04619ad62257 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:14.475660 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7ca07fff-b596-489d-91d6-04619ad62257 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:15.725483 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-c5b66e19-c858-4cde-b7ad-c51a617bab28 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-525275166", "imageRef": "cfccedbb-7169-47ec-9bae-d4829cba54e1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c615d296-1c4b-42bd-b81b-913328306550"}], "security_groups": [{"name": "tempest-securitygroup--1446392233"}], "key_name": "tempest-keypair-467884376", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:15.830291 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.network.neutron [None req-c5b66e19-c858-4cde-b7ad-c51a617bab28 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] validate_networks() for [('c615d296-1c4b-42bd-b81b-913328306550', None, None, None, None, None)] {{(pid=116941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:39:16.186112 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-c5b66e19-c858-4cde-b7ad-c51a617bab28 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Flavor limits 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:39:16.186539 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-c5b66e19-c858-4cde-b7ad-c51a617bab28 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Image limits 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:39:16.187046 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-c5b66e19-c858-4cde-b7ad-c51a617bab28 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Flavor pref 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:39:16.187483 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-c5b66e19-c858-4cde-b7ad-c51a617bab28 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Image pref 0:0:0 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:39:16.187894 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.virt.hardware [None req-c5b66e19-c858-4cde-b7ad-c51a617bab28 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:39:16.196832 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c5b66e19-c858-4cde-b7ad-c51a617bab28 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:16.197273 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c5b66e19-c858-4cde-b7ad-c51a617bab28 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:16.198083 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c5b66e19-c858-4cde-b7ad-c51a617bab28 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:16.198517 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c5b66e19-c858-4cde-b7ad-c51a617bab28 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:16.214398 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-c5b66e19-c858-4cde-b7ad-c51a617bab28 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Getting quotas for project 4cde9c0e34334ad7a7e79bfeb8963935. Resources: {'cores', 'instances', 'ram'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:39:16.218212 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.quota [None req-c5b66e19-c858-4cde-b7ad-c51a617bab28 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Getting quotas for user e2f51c315df74089bc6873e889cf80d7 and project 4cde9c0e34334ad7a7e79bfeb8963935. Resources: {'cores', 'instances', 'ram'} {{(pid=116941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:39:16.229263 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-c5b66e19-c858-4cde-b7ad-c51a617bab28 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Going to run 1 instances... {{(pid=116941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:39:16.231516 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-c5b66e19-c858-4cde-b7ad-c51a617bab28 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cfccedbb-7169-47ec-9bae-d4829cba54e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:39:16.276351 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-c5b66e19-c858-4cde-b7ad-c51a617bab28 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.555922 Dec 15 13:39:16.276991 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 511/1029] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Dec 15 13:39:15 2021] POST /compute/v2.1/servers => generated 402 bytes in 557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 15 13:39:16.286271 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-2284d8ac-bafd-4566-b605-ea22b73b5ed9 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:16.286896 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-2284d8ac-bafd-4566-b605-ea22b73b5ed9 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:16.339788 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-2284d8ac-bafd-4566-b605-ea22b73b5ed9 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:16.346293 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-2284d8ac-bafd-4566-b605-ea22b73b5ed9 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769" status: 200 len: 1236 microversion: 2.1 time: 0.063461 Dec 15 13:39:16.346869 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 512/1030] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:16 2021] GET /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769 => generated 1236 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:39:17.362896 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-c6b79e9a-c1f9-4a7f-b723-4dda1583faa9 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:17.363538 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-c6b79e9a-c1f9-4a7f-b723-4dda1583faa9 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:17.369814 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c6b79e9a-c1f9-4a7f-b723-4dda1583faa9 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:17.370268 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c6b79e9a-c1f9-4a7f-b723-4dda1583faa9 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:17.371089 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c6b79e9a-c1f9-4a7f-b723-4dda1583faa9 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:17.371532 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c6b79e9a-c1f9-4a7f-b723-4dda1583faa9 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:17.428820 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-c6b79e9a-c1f9-4a7f-b723-4dda1583faa9 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:17.435916 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-c6b79e9a-c1f9-4a7f-b723-4dda1583faa9 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769" status: 200 len: 1240 microversion: 2.1 time: 0.076768 Dec 15 13:39:17.436481 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 513/1031] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:17 2021] GET /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769 => generated 1240 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:39:18.235486 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-7ca07fff-b596-489d-91d6-04619ad62257 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 28194 microversion: 2.20 time: 3.773654 Dec 15 13:39:18.236136 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 519/1032] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:39:14 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 28194 bytes in 3775 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:39:18.454156 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-38175cc3-e0a1-42bc-9227-18ca7453c329 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:18.454734 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-38175cc3-e0a1-42bc-9227-18ca7453c329 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:18.464143 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-38175cc3-e0a1-42bc-9227-18ca7453c329 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:18.464766 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-38175cc3-e0a1-42bc-9227-18ca7453c329 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:18.465761 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-38175cc3-e0a1-42bc-9227-18ca7453c329 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:18.466311 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-38175cc3-e0a1-42bc-9227-18ca7453c329 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:18.527138 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-38175cc3-e0a1-42bc-9227-18ca7453c329 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:18.534383 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-38175cc3-e0a1-42bc-9227-18ca7453c329 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769" status: 200 len: 1288 microversion: 2.1 time: 0.084738 Dec 15 13:39:18.535023 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 514/1033] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:18 2021] GET /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769 => generated 1288 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:19.247457 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-511b17e3-884c-42d6-9ea8-71b9e807b7fa tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:19.248620 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-511b17e3-884c-42d6-9ea8-71b9e807b7fa tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:19.256518 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-511b17e3-884c-42d6-9ea8-71b9e807b7fa tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:19.256984 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-511b17e3-884c-42d6-9ea8-71b9e807b7fa tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:19.257783 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-511b17e3-884c-42d6-9ea8-71b9e807b7fa tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:19.258222 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-511b17e3-884c-42d6-9ea8-71b9e807b7fa tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:19.396624 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-511b17e3-884c-42d6-9ea8-71b9e807b7fa tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 28194 microversion: 2.20 time: 0.152988 Dec 15 13:39:19.397447 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 520/1034] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:39:19 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 28194 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:39:19.551510 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-9e9a743e-b1de-4590-9f6b-0c68f59fb55d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:19.552127 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-9e9a743e-b1de-4590-9f6b-0c68f59fb55d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:19.558468 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9e9a743e-b1de-4590-9f6b-0c68f59fb55d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:19.558953 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9e9a743e-b1de-4590-9f6b-0c68f59fb55d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:19.559743 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9e9a743e-b1de-4590-9f6b-0c68f59fb55d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:19.560187 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9e9a743e-b1de-4590-9f6b-0c68f59fb55d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:19.619462 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-9e9a743e-b1de-4590-9f6b-0c68f59fb55d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:19.626745 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-9e9a743e-b1de-4590-9f6b-0c68f59fb55d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769" status: 200 len: 1294 microversion: 2.1 time: 0.078986 Dec 15 13:39:19.627354 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 515/1035] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:19 2021] GET /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769 => generated 1294 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:20.409340 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-262ea4e1-35d0-453b-98ce-da37de498d37 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:20.411144 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-262ea4e1-35d0-453b-98ce-da37de498d37 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:20.418164 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-262ea4e1-35d0-453b-98ce-da37de498d37 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:20.418702 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-262ea4e1-35d0-453b-98ce-da37de498d37 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:20.419604 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-262ea4e1-35d0-453b-98ce-da37de498d37 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:20.420116 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-262ea4e1-35d0-453b-98ce-da37de498d37 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:20.483226 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-262ea4e1-35d0-453b-98ce-da37de498d37 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 28194 microversion: 2.20 time: 0.076495 Dec 15 13:39:20.488706 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 521/1036] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:39:20 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 28194 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:39:20.489993 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-c00b296f-62fa-4674-acd7-e94a24901a16 req-bd0d3fcb-358e-4606-b9eb-c00ed7f793c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11606c02-c86d-4be7-af13-296b7061f769", "tag": "b79a2306-1e2f-41f0-8f14-42fe5c03e832"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:20.493053 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:39:20.493053 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: warnings.warn(msg) Dec 15 13:39:20.504035 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-c00b296f-62fa-4674-acd7-e94a24901a16 req-bd0d3fcb-358e-4606-b9eb-c00ed7f793c9 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:20.506765 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-c00b296f-62fa-4674-acd7-e94a24901a16 req-bd0d3fcb-358e-4606-b9eb-c00ed7f793c9 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:20.519403 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-c00b296f-62fa-4674-acd7-e94a24901a16 req-bd0d3fcb-358e-4606-b9eb-c00ed7f793c9 service nova] Creating event network-changed:b79a2306-1e2f-41f0-8f14-42fe5c03e832 for instance 11606c02-c86d-4be7-af13-296b7061f769 on hv-cinder-81322 Dec 15 13:39:20.543677 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-c00b296f-62fa-4674-acd7-e94a24901a16 req-bd0d3fcb-358e-4606-b9eb-c00ed7f793c9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064811 Dec 15 13:39:20.544693 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 516/1037] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:39:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:39:20.644469 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ba763371-ec31-4c5b-ba39-95e4125d90c9 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:20.645210 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ba763371-ec31-4c5b-ba39-95e4125d90c9 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:20.652227 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ba763371-ec31-4c5b-ba39-95e4125d90c9 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:20.652697 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ba763371-ec31-4c5b-ba39-95e4125d90c9 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:20.653491 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ba763371-ec31-4c5b-ba39-95e4125d90c9 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:20.653937 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ba763371-ec31-4c5b-ba39-95e4125d90c9 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:20.792313 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-ba763371-ec31-4c5b-ba39-95e4125d90c9 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:20.799814 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ba763371-ec31-4c5b-ba39-95e4125d90c9 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769" status: 200 len: 1362 microversion: 2.1 time: 0.159309 Dec 15 13:39:20.800438 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 522/1038] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:20 2021] GET /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:21.496520 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-0322a2d7-c98e-4040-8856-5cc7e33795ab tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:21.497529 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-0322a2d7-c98e-4040-8856-5cc7e33795ab tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:21.503778 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0322a2d7-c98e-4040-8856-5cc7e33795ab tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:21.504183 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0322a2d7-c98e-4040-8856-5cc7e33795ab tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:21.504944 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0322a2d7-c98e-4040-8856-5cc7e33795ab tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:21.505402 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0322a2d7-c98e-4040-8856-5cc7e33795ab tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:21.657099 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-0322a2d7-c98e-4040-8856-5cc7e33795ab tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 28194 microversion: 2.20 time: 0.165065 Dec 15 13:39:21.658420 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 517/1039] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:39:21 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 28194 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:39:21.817221 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-514bbe06-2326-40d8-8df1-381a517f845a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:21.817768 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-514bbe06-2326-40d8-8df1-381a517f845a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:21.824091 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-514bbe06-2326-40d8-8df1-381a517f845a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:21.824551 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-514bbe06-2326-40d8-8df1-381a517f845a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:21.825334 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-514bbe06-2326-40d8-8df1-381a517f845a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:21.825811 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-514bbe06-2326-40d8-8df1-381a517f845a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:21.951215 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-514bbe06-2326-40d8-8df1-381a517f845a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:21.958648 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-514bbe06-2326-40d8-8df1-381a517f845a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769" status: 200 len: 1362 microversion: 2.1 time: 0.145866 Dec 15 13:39:21.959254 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 523/1040] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:21 2021] GET /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769 => generated 1362 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:22.669358 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-44f46daa-01de-4db4-9ede-024c04e04b85 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:22.670282 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-44f46daa-01de-4db4-9ede-024c04e04b85 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:22.677219 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-44f46daa-01de-4db4-9ede-024c04e04b85 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:22.677670 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-44f46daa-01de-4db4-9ede-024c04e04b85 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:22.678451 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-44f46daa-01de-4db4-9ede-024c04e04b85 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:22.678919 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-44f46daa-01de-4db4-9ede-024c04e04b85 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:22.737571 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-44f46daa-01de-4db4-9ede-024c04e04b85 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 28194 microversion: 2.20 time: 0.072360 Dec 15 13:39:22.738479 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 518/1041] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:39:22 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 28194 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:39:22.974411 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-f0bad7f9-ab95-4947-be65-66befbdfa8fe tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:22.975035 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-f0bad7f9-ab95-4947-be65-66befbdfa8fe tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:22.981233 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f0bad7f9-ab95-4947-be65-66befbdfa8fe tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:22.981683 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f0bad7f9-ab95-4947-be65-66befbdfa8fe tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:22.982455 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f0bad7f9-ab95-4947-be65-66befbdfa8fe tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:22.982917 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f0bad7f9-ab95-4947-be65-66befbdfa8fe tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:23.109660 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-f0bad7f9-ab95-4947-be65-66befbdfa8fe tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:23.117418 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-f0bad7f9-ab95-4947-be65-66befbdfa8fe tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769" status: 200 len: 1362 microversion: 2.1 time: 0.146708 Dec 15 13:39:23.118003 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 524/1042] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:22 2021] GET /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:23.748948 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-b61cb8ea-7b69-4bd0-a5f6-a5981af44b8c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:23.749952 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-b61cb8ea-7b69-4bd0-a5f6-a5981af44b8c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:23.756889 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b61cb8ea-7b69-4bd0-a5f6-a5981af44b8c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:23.757338 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b61cb8ea-7b69-4bd0-a5f6-a5981af44b8c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:23.758120 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b61cb8ea-7b69-4bd0-a5f6-a5981af44b8c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:23.758556 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b61cb8ea-7b69-4bd0-a5f6-a5981af44b8c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:23.832398 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-b61cb8ea-7b69-4bd0-a5f6-a5981af44b8c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 28194 microversion: 2.20 time: 0.087593 Dec 15 13:39:23.833051 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 519/1043] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:39:23 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 28194 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:39:24.134588 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-df0fee40-fac5-43ea-acaf-36306c2fb8ba tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:24.135232 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-df0fee40-fac5-43ea-acaf-36306c2fb8ba tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:24.141599 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-df0fee40-fac5-43ea-acaf-36306c2fb8ba tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:24.142050 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-df0fee40-fac5-43ea-acaf-36306c2fb8ba tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:24.142838 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-df0fee40-fac5-43ea-acaf-36306c2fb8ba tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:24.143299 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-df0fee40-fac5-43ea-acaf-36306c2fb8ba tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:24.271861 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-df0fee40-fac5-43ea-acaf-36306c2fb8ba tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:24.279387 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-df0fee40-fac5-43ea-acaf-36306c2fb8ba tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769" status: 200 len: 1362 microversion: 2.1 time: 0.148546 Dec 15 13:39:24.288113 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 525/1044] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:24 2021] GET /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:24.847780 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-92fdf1d4-709e-4b95-a88c-9d5b085880eb tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:24.849822 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-92fdf1d4-709e-4b95-a88c-9d5b085880eb tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:24.857470 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-92fdf1d4-709e-4b95-a88c-9d5b085880eb tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:24.858021 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-92fdf1d4-709e-4b95-a88c-9d5b085880eb tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:24.861278 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-92fdf1d4-709e-4b95-a88c-9d5b085880eb tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:24.861747 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-92fdf1d4-709e-4b95-a88c-9d5b085880eb tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:24.933720 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-92fdf1d4-709e-4b95-a88c-9d5b085880eb tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 28194 microversion: 2.20 time: 0.091723 Dec 15 13:39:24.938094 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 520/1045] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:39:24 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 28194 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:39:25.295596 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-34438c5f-1d03-434f-9993-ee5c992d0177 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:25.296238 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-34438c5f-1d03-434f-9993-ee5c992d0177 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:25.302571 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-34438c5f-1d03-434f-9993-ee5c992d0177 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:25.303059 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-34438c5f-1d03-434f-9993-ee5c992d0177 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:25.303836 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-34438c5f-1d03-434f-9993-ee5c992d0177 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:25.304269 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-34438c5f-1d03-434f-9993-ee5c992d0177 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:25.434245 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-34438c5f-1d03-434f-9993-ee5c992d0177 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:25.441574 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-34438c5f-1d03-434f-9993-ee5c992d0177 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769" status: 200 len: 1362 microversion: 2.1 time: 0.149830 Dec 15 13:39:25.442144 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 526/1046] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:25 2021] GET /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:25.947788 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-94a7f6a4-bb90-4b97-8241-ce863e47f0ed tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:25.948798 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-94a7f6a4-bb90-4b97-8241-ce863e47f0ed tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:25.955981 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-94a7f6a4-bb90-4b97-8241-ce863e47f0ed tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:25.956441 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-94a7f6a4-bb90-4b97-8241-ce863e47f0ed tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:25.957231 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-94a7f6a4-bb90-4b97-8241-ce863e47f0ed tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:25.957674 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-94a7f6a4-bb90-4b97-8241-ce863e47f0ed tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:26.023507 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-94a7f6a4-bb90-4b97-8241-ce863e47f0ed tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 28194 microversion: 2.20 time: 0.080309 Dec 15 13:39:26.024132 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 521/1047] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:39:25 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 28194 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:39:26.457414 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-3123a738-a338-4ea1-8a9d-c1e2c30f1da8 req-d9b0e02d-f57d-4674-82d8-33f4dd6bbbb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11606c02-c86d-4be7-af13-296b7061f769", "name": "network-vif-plugged", "status": "completed", "tag": "b79a2306-1e2f-41f0-8f14-42fe5c03e832"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:26.459660 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-93f94223-aea1-46c4-b4d2-f5cf87d6b23e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:26.459814 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:39:26.459814 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: warnings.warn(msg) Dec 15 13:39:26.460364 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-93f94223-aea1-46c4-b4d2-f5cf87d6b23e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:26.467442 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-93f94223-aea1-46c4-b4d2-f5cf87d6b23e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:26.467886 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-93f94223-aea1-46c4-b4d2-f5cf87d6b23e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:26.468721 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-93f94223-aea1-46c4-b4d2-f5cf87d6b23e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:26.469012 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-3123a738-a338-4ea1-8a9d-c1e2c30f1da8 req-d9b0e02d-f57d-4674-82d8-33f4dd6bbbb7 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:26.469383 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-93f94223-aea1-46c4-b4d2-f5cf87d6b23e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:26.470165 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-3123a738-a338-4ea1-8a9d-c1e2c30f1da8 req-d9b0e02d-f57d-4674-82d8-33f4dd6bbbb7 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:26.481531 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-3123a738-a338-4ea1-8a9d-c1e2c30f1da8 req-d9b0e02d-f57d-4674-82d8-33f4dd6bbbb7 service nova] Creating event network-vif-plugged:b79a2306-1e2f-41f0-8f14-42fe5c03e832 for instance 11606c02-c86d-4be7-af13-296b7061f769 on hv-cinder-81322 Dec 15 13:39:26.486435 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-3123a738-a338-4ea1-8a9d-c1e2c30f1da8 req-d9b0e02d-f57d-4674-82d8-33f4dd6bbbb7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034981 Dec 15 13:39:26.487272 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 527/1048] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:39:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:39:26.606622 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-93f94223-aea1-46c4-b4d2-f5cf87d6b23e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:26.614070 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-93f94223-aea1-46c4-b4d2-f5cf87d6b23e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769" status: 200 len: 1362 microversion: 2.1 time: 0.159165 Dec 15 13:39:26.614685 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 522/1049] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:26 2021] GET /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:39:27.035332 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-f9328dfd-3b44-4397-97ee-970ba952ba7e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:27.036315 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-f9328dfd-3b44-4397-97ee-970ba952ba7e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:27.043146 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f9328dfd-3b44-4397-97ee-970ba952ba7e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:27.043597 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f9328dfd-3b44-4397-97ee-970ba952ba7e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:27.044373 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f9328dfd-3b44-4397-97ee-970ba952ba7e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:27.044809 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f9328dfd-3b44-4397-97ee-970ba952ba7e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:27.104987 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-f9328dfd-3b44-4397-97ee-970ba952ba7e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 28194 microversion: 2.20 time: 0.073566 Dec 15 13:39:27.105543 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 528/1050] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:39:27 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 28194 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:39:27.630171 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-a746a74e-ddc6-419d-bbf3-c25676c1e03e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:27.630812 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-a746a74e-ddc6-419d-bbf3-c25676c1e03e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:27.637096 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a746a74e-ddc6-419d-bbf3-c25676c1e03e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:27.637548 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a746a74e-ddc6-419d-bbf3-c25676c1e03e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:27.638329 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a746a74e-ddc6-419d-bbf3-c25676c1e03e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:27.638767 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a746a74e-ddc6-419d-bbf3-c25676c1e03e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:27.767553 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-a746a74e-ddc6-419d-bbf3-c25676c1e03e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:27.775219 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-a746a74e-ddc6-419d-bbf3-c25676c1e03e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769" status: 200 len: 1362 microversion: 2.1 time: 0.148801 Dec 15 13:39:27.775795 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 523/1051] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:27 2021] GET /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:28.124093 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-d6a4e637-283b-4767-9408-54536a95146f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:28.125098 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-d6a4e637-283b-4767-9408-54536a95146f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:28.131730 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d6a4e637-283b-4767-9408-54536a95146f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:28.132188 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d6a4e637-283b-4767-9408-54536a95146f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:28.132974 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d6a4e637-283b-4767-9408-54536a95146f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:28.133418 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d6a4e637-283b-4767-9408-54536a95146f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:28.193755 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-d6a4e637-283b-4767-9408-54536a95146f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 28194 microversion: 2.20 time: 0.072977 Dec 15 13:39:28.194370 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 529/1052] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:39:28 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 28194 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:39:28.794289 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-0df050ee-d8ca-42b0-ae7e-e61f79daa3a0 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:28.795611 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-0df050ee-d8ca-42b0-ae7e-e61f79daa3a0 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:28.802200 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0df050ee-d8ca-42b0-ae7e-e61f79daa3a0 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:28.802656 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0df050ee-d8ca-42b0-ae7e-e61f79daa3a0 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:28.803519 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0df050ee-d8ca-42b0-ae7e-e61f79daa3a0 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:28.803962 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0df050ee-d8ca-42b0-ae7e-e61f79daa3a0 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:28.933145 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-0df050ee-d8ca-42b0-ae7e-e61f79daa3a0 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:28.940323 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-0df050ee-d8ca-42b0-ae7e-e61f79daa3a0 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769" status: 200 len: 1547 microversion: 2.1 time: 0.149780 Dec 15 13:39:28.940895 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 524/1053] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:28 2021] GET /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769 => generated 1547 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:28.956862 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-37ad366d-28d6-4b25-944c-c522aedc686c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:28.957385 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-37ad366d-28d6-4b25-944c-c522aedc686c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:28.965911 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-37ad366d-28d6-4b25-944c-c522aedc686c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:28.966678 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-37ad366d-28d6-4b25-944c-c522aedc686c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:28.968082 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-37ad366d-28d6-4b25-944c-c522aedc686c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:28.968888 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-37ad366d-28d6-4b25-944c-c522aedc686c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:29.052015 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-37ad366d-28d6-4b25-944c-c522aedc686c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099144 Dec 15 13:39:29.052708 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 530/1054] 10.222.0.60 () {58 vars in 1274 bytes} [Wed Dec 15 13:39:28 2021] GET /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:39:29.205536 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-4c1b17cd-f26b-444b-a3f7-c83f4e0afe48 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:29.206462 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-4c1b17cd-f26b-444b-a3f7-c83f4e0afe48 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:29.212945 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4c1b17cd-f26b-444b-a3f7-c83f4e0afe48 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:29.213647 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4c1b17cd-f26b-444b-a3f7-c83f4e0afe48 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:29.214453 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4c1b17cd-f26b-444b-a3f7-c83f4e0afe48 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:29.214927 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4c1b17cd-f26b-444b-a3f7-c83f4e0afe48 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:29.298076 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-4c1b17cd-f26b-444b-a3f7-c83f4e0afe48 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 28194 microversion: 2.20 time: 0.095656 Dec 15 13:39:29.299425 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 525/1055] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:39:29 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 28194 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:39:30.209367 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-2fd1f98b-b98b-454d-90a5-b96bf7c982e0 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:30.210319 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-2fd1f98b-b98b-454d-90a5-b96bf7c982e0 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:30.214116 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-484245e6-538d-4295-95e3-4482acb30124 req-457705f8-b0ff-40bd-8465-bc221b9ddf79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11606c02-c86d-4be7-af13-296b7061f769", "tag": "b79a2306-1e2f-41f0-8f14-42fe5c03e832"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:30.217012 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:39:30.217012 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: warnings.warn(msg) Dec 15 13:39:30.222828 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2fd1f98b-b98b-454d-90a5-b96bf7c982e0 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:30.223316 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2fd1f98b-b98b-454d-90a5-b96bf7c982e0 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:30.224739 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2fd1f98b-b98b-454d-90a5-b96bf7c982e0 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:30.225181 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2fd1f98b-b98b-454d-90a5-b96bf7c982e0 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:30.228015 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-484245e6-538d-4295-95e3-4482acb30124 req-457705f8-b0ff-40bd-8465-bc221b9ddf79 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:30.228688 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-484245e6-538d-4295-95e3-4482acb30124 req-457705f8-b0ff-40bd-8465-bc221b9ddf79 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:30.245206 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-484245e6-538d-4295-95e3-4482acb30124 req-457705f8-b0ff-40bd-8465-bc221b9ddf79 service nova] Creating event network-changed:b79a2306-1e2f-41f0-8f14-42fe5c03e832 for instance 11606c02-c86d-4be7-af13-296b7061f769 on hv-cinder-81322 Dec 15 13:39:30.253109 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-484245e6-538d-4295-95e3-4482acb30124 req-457705f8-b0ff-40bd-8465-bc221b9ddf79 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044342 Dec 15 13:39:30.258916 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 526/1056] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:39:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:39:30.308193 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-2fd1f98b-b98b-454d-90a5-b96bf7c982e0 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 14 microversion: 2.1 time: 0.102773 Dec 15 13:39:30.309221 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 531/1057] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:39:30 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:39:30.310717 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-cbd866fd-17f3-4c3d-bcc2-8863d4928457 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:30.311882 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-cbd866fd-17f3-4c3d-bcc2-8863d4928457 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:30.318733 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cbd866fd-17f3-4c3d-bcc2-8863d4928457 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:30.319234 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cbd866fd-17f3-4c3d-bcc2-8863d4928457 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:30.320202 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cbd866fd-17f3-4c3d-bcc2-8863d4928457 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:30.320641 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cbd866fd-17f3-4c3d-bcc2-8863d4928457 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:30.400192 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-cbd866fd-17f3-4c3d-bcc2-8863d4928457 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 28322 microversion: 2.20 time: 0.093763 Dec 15 13:39:30.401405 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 527/1058] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:39:30 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 28322 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:39:31.320341 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-c35cf0d5-cc5f-4940-ab4b-e01cc27d084d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:31.321381 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-c35cf0d5-cc5f-4940-ab4b-e01cc27d084d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:31.328481 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c35cf0d5-cc5f-4940-ab4b-e01cc27d084d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:31.328941 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c35cf0d5-cc5f-4940-ab4b-e01cc27d084d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:31.329732 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c35cf0d5-cc5f-4940-ab4b-e01cc27d084d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:31.330176 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c35cf0d5-cc5f-4940-ab4b-e01cc27d084d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:31.390729 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-c35cf0d5-cc5f-4940-ab4b-e01cc27d084d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 14 microversion: 2.1 time: 0.074853 Dec 15 13:39:31.393941 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 532/1059] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:39:31 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:39:31.412741 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-5906fed0-cecf-43b0-b981-8c69557d334f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:31.413754 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-5906fed0-cecf-43b0-b981-8c69557d334f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:31.420617 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5906fed0-cecf-43b0-b981-8c69557d334f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:31.421072 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5906fed0-cecf-43b0-b981-8c69557d334f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:31.421864 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5906fed0-cecf-43b0-b981-8c69557d334f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:31.422429 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5906fed0-cecf-43b0-b981-8c69557d334f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:31.505081 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-5906fed0-cecf-43b0-b981-8c69557d334f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 28485 microversion: 2.20 time: 0.096405 Dec 15 13:39:31.506301 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 528/1060] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:39:31 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 28485 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:39:32.402766 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-e30e60fa-b310-4479-ab38-47d935294e67 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:32.403798 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-e30e60fa-b310-4479-ab38-47d935294e67 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:32.410725 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e30e60fa-b310-4479-ab38-47d935294e67 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:32.411211 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e30e60fa-b310-4479-ab38-47d935294e67 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:32.412003 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e30e60fa-b310-4479-ab38-47d935294e67 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:32.412448 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e30e60fa-b310-4479-ab38-47d935294e67 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:32.469668 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-e30e60fa-b310-4479-ab38-47d935294e67 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 14 microversion: 2.1 time: 0.070824 Dec 15 13:39:32.470290 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 533/1061] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:39:32 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:39:32.517105 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-35ffe56d-1d48-47eb-9685-929f793d9efb tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:32.518146 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-35ffe56d-1d48-47eb-9685-929f793d9efb tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:32.525526 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-35ffe56d-1d48-47eb-9685-929f793d9efb tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:32.525982 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-35ffe56d-1d48-47eb-9685-929f793d9efb tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:32.526783 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-35ffe56d-1d48-47eb-9685-929f793d9efb tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:32.527251 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-35ffe56d-1d48-47eb-9685-929f793d9efb tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:32.602673 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-35ffe56d-1d48-47eb-9685-929f793d9efb tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 28653 microversion: 2.20 time: 0.089348 Dec 15 13:39:32.603237 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 529/1062] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:39:32 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 28653 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:39:33.481592 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-2cfd070f-a3a2-4fbf-856c-627d05032380 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:33.482588 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-2cfd070f-a3a2-4fbf-856c-627d05032380 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:33.489448 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2cfd070f-a3a2-4fbf-856c-627d05032380 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:33.489979 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2cfd070f-a3a2-4fbf-856c-627d05032380 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:33.490771 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2cfd070f-a3a2-4fbf-856c-627d05032380 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:33.491247 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2cfd070f-a3a2-4fbf-856c-627d05032380 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:33.548935 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-2cfd070f-a3a2-4fbf-856c-627d05032380 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 14 microversion: 2.1 time: 0.071320 Dec 15 13:39:33.549558 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 534/1063] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:39:33 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:39:33.614018 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-511050fc-f366-461a-ae56-8ef30d92a900 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:33.615024 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-511050fc-f366-461a-ae56-8ef30d92a900 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:33.621912 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-511050fc-f366-461a-ae56-8ef30d92a900 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:33.622369 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-511050fc-f366-461a-ae56-8ef30d92a900 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:33.623220 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-511050fc-f366-461a-ae56-8ef30d92a900 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:33.623663 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-511050fc-f366-461a-ae56-8ef30d92a900 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:33.687075 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-511050fc-f366-461a-ae56-8ef30d92a900 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 28653 microversion: 2.20 time: 0.077075 Dec 15 13:39:33.687977 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 530/1064] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:39:33 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 28653 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:39:34.560142 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ac14366f-0606-462f-be99-1a9e4237f8db tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:34.561137 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ac14366f-0606-462f-be99-1a9e4237f8db tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:34.567965 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ac14366f-0606-462f-be99-1a9e4237f8db tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:34.568423 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ac14366f-0606-462f-be99-1a9e4237f8db tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:34.569206 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ac14366f-0606-462f-be99-1a9e4237f8db tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:34.569647 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ac14366f-0606-462f-be99-1a9e4237f8db tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:34.636985 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ac14366f-0606-462f-be99-1a9e4237f8db tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 14 microversion: 2.1 time: 0.080715 Dec 15 13:39:34.637590 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 535/1065] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:39:34 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:39:34.698695 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-1e5f8549-4080-4088-988e-f9bc9c2a0283 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:34.699772 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-1e5f8549-4080-4088-988e-f9bc9c2a0283 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:34.706911 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1e5f8549-4080-4088-988e-f9bc9c2a0283 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:34.707371 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1e5f8549-4080-4088-988e-f9bc9c2a0283 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:34.708157 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1e5f8549-4080-4088-988e-f9bc9c2a0283 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:34.708600 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1e5f8549-4080-4088-988e-f9bc9c2a0283 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:34.770498 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-1e5f8549-4080-4088-988e-f9bc9c2a0283 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 28653 microversion: 2.20 time: 0.075747 Dec 15 13:39:34.771188 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 531/1066] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:39:34 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 28653 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:39:35.649296 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-d8336847-d3ac-4cac-971c-d39bedf76f3a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:35.650329 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-d8336847-d3ac-4cac-971c-d39bedf76f3a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:35.657229 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d8336847-d3ac-4cac-971c-d39bedf76f3a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:35.657688 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d8336847-d3ac-4cac-971c-d39bedf76f3a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:35.658478 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d8336847-d3ac-4cac-971c-d39bedf76f3a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:35.658945 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d8336847-d3ac-4cac-971c-d39bedf76f3a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:35.729844 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-d8336847-d3ac-4cac-971c-d39bedf76f3a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 14 microversion: 2.1 time: 0.085039 Dec 15 13:39:35.730478 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 536/1067] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:39:35 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:39:35.782033 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-442b358b-38a9-43c1-bde8-26cf93c90f74 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:35.783079 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-442b358b-38a9-43c1-bde8-26cf93c90f74 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:35.789985 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-442b358b-38a9-43c1-bde8-26cf93c90f74 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:35.790437 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-442b358b-38a9-43c1-bde8-26cf93c90f74 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:35.791255 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-442b358b-38a9-43c1-bde8-26cf93c90f74 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:35.791696 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-442b358b-38a9-43c1-bde8-26cf93c90f74 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:35.857223 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-442b358b-38a9-43c1-bde8-26cf93c90f74 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 28653 microversion: 2.20 time: 0.079124 Dec 15 13:39:35.857857 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 532/1068] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:39:35 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 28653 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:39:36.741626 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-d9c7153c-9a45-4007-b287-8e58a7348999 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:36.742626 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-d9c7153c-9a45-4007-b287-8e58a7348999 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:36.749443 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d9c7153c-9a45-4007-b287-8e58a7348999 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:36.749892 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d9c7153c-9a45-4007-b287-8e58a7348999 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:36.750662 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d9c7153c-9a45-4007-b287-8e58a7348999 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:36.751122 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d9c7153c-9a45-4007-b287-8e58a7348999 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:36.805852 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-d9c7153c-9a45-4007-b287-8e58a7348999 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 14 microversion: 2.1 time: 0.068571 Dec 15 13:39:36.806483 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 537/1069] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:39:36 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 14 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:39:36.869450 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-b7869628-9031-4fc2-9688-e3fe74aa2b3f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:36.870445 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-b7869628-9031-4fc2-9688-e3fe74aa2b3f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:36.877353 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b7869628-9031-4fc2-9688-e3fe74aa2b3f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:36.877802 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b7869628-9031-4fc2-9688-e3fe74aa2b3f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:36.878576 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b7869628-9031-4fc2-9688-e3fe74aa2b3f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:36.879048 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b7869628-9031-4fc2-9688-e3fe74aa2b3f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:36.945095 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-b7869628-9031-4fc2-9688-e3fe74aa2b3f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 28653 microversion: 2.20 time: 0.079477 Dec 15 13:39:36.945647 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 533/1070] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:39:36 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 28653 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:39:37.816605 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-364ff14d-80c4-4484-bfb8-24a841ccff7e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:37.817601 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-364ff14d-80c4-4484-bfb8-24a841ccff7e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:37.824422 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-364ff14d-80c4-4484-bfb8-24a841ccff7e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:37.824876 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-364ff14d-80c4-4484-bfb8-24a841ccff7e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:37.825651 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-364ff14d-80c4-4484-bfb8-24a841ccff7e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:37.826085 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-364ff14d-80c4-4484-bfb8-24a841ccff7e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:37.884530 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-364ff14d-80c4-4484-bfb8-24a841ccff7e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 14 microversion: 2.1 time: 0.071748 Dec 15 13:39:37.885187 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 538/1071] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:39:37 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:39:37.956863 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-d6db8782-6eec-4cc8-a90a-81a84bd69bc0 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:37.957794 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-d6db8782-6eec-4cc8-a90a-81a84bd69bc0 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:37.965096 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d6db8782-6eec-4cc8-a90a-81a84bd69bc0 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:37.965548 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d6db8782-6eec-4cc8-a90a-81a84bd69bc0 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:37.966368 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d6db8782-6eec-4cc8-a90a-81a84bd69bc0 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:37.966804 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d6db8782-6eec-4cc8-a90a-81a84bd69bc0 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:38.029449 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-d6db8782-6eec-4cc8-a90a-81a84bd69bc0 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 28653 microversion: 2.20 time: 0.076851 Dec 15 13:39:38.030072 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 534/1072] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:39:37 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 28653 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:39:38.895612 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-37c6d7c2-b937-4fd3-b5cf-e0e3aaa19cf3 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:38.896618 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-37c6d7c2-b937-4fd3-b5cf-e0e3aaa19cf3 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:38.903422 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-37c6d7c2-b937-4fd3-b5cf-e0e3aaa19cf3 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:38.903877 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-37c6d7c2-b937-4fd3-b5cf-e0e3aaa19cf3 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:38.904661 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-37c6d7c2-b937-4fd3-b5cf-e0e3aaa19cf3 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:38.905103 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-37c6d7c2-b937-4fd3-b5cf-e0e3aaa19cf3 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:38.963184 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-37c6d7c2-b937-4fd3-b5cf-e0e3aaa19cf3 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 14 microversion: 2.1 time: 0.071452 Dec 15 13:39:38.963788 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 539/1073] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:39:38 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:39:39.041360 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-078cd3dd-b204-463c-bf5b-8256d22043e5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:39.042356 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-078cd3dd-b204-463c-bf5b-8256d22043e5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:39.049297 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-078cd3dd-b204-463c-bf5b-8256d22043e5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:39.049745 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-078cd3dd-b204-463c-bf5b-8256d22043e5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:39.050528 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-078cd3dd-b204-463c-bf5b-8256d22043e5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:39.051094 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-078cd3dd-b204-463c-bf5b-8256d22043e5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:39.126733 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-078cd3dd-b204-463c-bf5b-8256d22043e5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 28653 microversion: 2.20 time: 0.089767 Dec 15 13:39:39.127417 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 535/1074] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:39:39 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 28653 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:39:39.974605 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-9adab690-13a6-48ae-b194-5f851a128c7f tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:39.975666 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-9adab690-13a6-48ae-b194-5f851a128c7f tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:39.982493 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9adab690-13a6-48ae-b194-5f851a128c7f tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:39.983001 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9adab690-13a6-48ae-b194-5f851a128c7f tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:39.983813 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9adab690-13a6-48ae-b194-5f851a128c7f tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:39.984260 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9adab690-13a6-48ae-b194-5f851a128c7f tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:40.044083 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-9adab690-13a6-48ae-b194-5f851a128c7f tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 14 microversion: 2.1 time: 0.073601 Dec 15 13:39:40.044731 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 540/1075] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:39:39 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:39:40.138762 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-92b5a98d-4d84-4f4b-b298-5b61fb99cb48 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:40.139819 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-92b5a98d-4d84-4f4b-b298-5b61fb99cb48 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:40.147309 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-92b5a98d-4d84-4f4b-b298-5b61fb99cb48 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:40.147799 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-92b5a98d-4d84-4f4b-b298-5b61fb99cb48 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:40.148600 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-92b5a98d-4d84-4f4b-b298-5b61fb99cb48 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:40.149040 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-92b5a98d-4d84-4f4b-b298-5b61fb99cb48 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:40.210732 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-92b5a98d-4d84-4f4b-b298-5b61fb99cb48 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 28653 microversion: 2.20 time: 0.075954 Dec 15 13:39:40.211402 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 536/1076] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:39:40 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 28653 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:39:41.055936 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-f77eff2d-9421-48f0-8b41-643f271c7c67 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:41.056961 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-f77eff2d-9421-48f0-8b41-643f271c7c67 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:41.063835 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f77eff2d-9421-48f0-8b41-643f271c7c67 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:41.064296 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f77eff2d-9421-48f0-8b41-643f271c7c67 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:41.065086 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f77eff2d-9421-48f0-8b41-643f271c7c67 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:41.065528 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f77eff2d-9421-48f0-8b41-643f271c7c67 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:41.156115 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-f77eff2d-9421-48f0-8b41-643f271c7c67 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 8596 microversion: 2.1 time: 0.104566 Dec 15 13:39:41.156756 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 541/1077] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:39:41 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 8596 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:41.222767 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-f21b5c0a-b5e4-43bd-9221-7d971ec8f31e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:41.223793 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-f21b5c0a-b5e4-43bd-9221-7d971ec8f31e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:41.230679 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f21b5c0a-b5e4-43bd-9221-7d971ec8f31e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:41.231156 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f21b5c0a-b5e4-43bd-9221-7d971ec8f31e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:41.231939 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f21b5c0a-b5e4-43bd-9221-7d971ec8f31e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:41.232377 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f21b5c0a-b5e4-43bd-9221-7d971ec8f31e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:41.309293 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-f21b5c0a-b5e4-43bd-9221-7d971ec8f31e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 28653 microversion: 2.20 time: 0.090504 Dec 15 13:39:41.310077 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 537/1078] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:39:41 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 28653 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:39:42.168286 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-1944f48f-589f-4f65-a612-6c2ddabec111 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:42.169285 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-1944f48f-589f-4f65-a612-6c2ddabec111 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:42.176075 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1944f48f-589f-4f65-a612-6c2ddabec111 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:42.176532 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1944f48f-589f-4f65-a612-6c2ddabec111 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:42.177316 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1944f48f-589f-4f65-a612-6c2ddabec111 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:42.178357 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1944f48f-589f-4f65-a612-6c2ddabec111 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:42.257592 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-1944f48f-589f-4f65-a612-6c2ddabec111 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 16364 microversion: 2.1 time: 0.093239 Dec 15 13:39:42.258209 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 542/1079] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:39:42 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 16364 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:39:42.321163 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-c39d11ad-aa11-42b0-ae15-23419d470d85 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:42.322157 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-c39d11ad-aa11-42b0-ae15-23419d470d85 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:42.329232 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c39d11ad-aa11-42b0-ae15-23419d470d85 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:42.329682 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c39d11ad-aa11-42b0-ae15-23419d470d85 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:42.330467 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c39d11ad-aa11-42b0-ae15-23419d470d85 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:42.330938 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c39d11ad-aa11-42b0-ae15-23419d470d85 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:42.405949 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-c39d11ad-aa11-42b0-ae15-23419d470d85 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 28653 microversion: 2.20 time: 0.088711 Dec 15 13:39:42.406616 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 538/1080] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:39:42 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 28653 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:39:43.269307 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-58dd29ef-3664-4b31-9230-c9b353423239 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:43.270306 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-58dd29ef-3664-4b31-9230-c9b353423239 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:43.277150 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-58dd29ef-3664-4b31-9230-c9b353423239 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:43.277600 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-58dd29ef-3664-4b31-9230-c9b353423239 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:43.278380 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-58dd29ef-3664-4b31-9230-c9b353423239 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:43.278817 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-58dd29ef-3664-4b31-9230-c9b353423239 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:43.352104 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-58dd29ef-3664-4b31-9230-c9b353423239 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 18449 microversion: 2.1 time: 0.086683 Dec 15 13:39:43.352755 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 543/1081] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:39:43 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 18449 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:39:43.417519 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-90a596c7-5759-4676-9354-0e7346ede3d5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:43.418555 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-90a596c7-5759-4676-9354-0e7346ede3d5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:43.425380 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-90a596c7-5759-4676-9354-0e7346ede3d5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:43.425828 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-90a596c7-5759-4676-9354-0e7346ede3d5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:43.426600 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-90a596c7-5759-4676-9354-0e7346ede3d5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:43.427060 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-90a596c7-5759-4676-9354-0e7346ede3d5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:43.487992 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-90a596c7-5759-4676-9354-0e7346ede3d5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 28653 microversion: 2.20 time: 0.074346 Dec 15 13:39:43.488635 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 539/1082] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:39:43 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 28653 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:39:44.363906 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-98e6f030-6a19-41df-b982-8e09cb848f66 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:44.364908 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-98e6f030-6a19-41df-b982-8e09cb848f66 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:44.371779 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-98e6f030-6a19-41df-b982-8e09cb848f66 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:44.372259 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-98e6f030-6a19-41df-b982-8e09cb848f66 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:44.373109 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-98e6f030-6a19-41df-b982-8e09cb848f66 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:44.373680 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-98e6f030-6a19-41df-b982-8e09cb848f66 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:44.455022 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-98e6f030-6a19-41df-b982-8e09cb848f66 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 20511 microversion: 2.1 time: 0.094766 Dec 15 13:39:44.455787 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 544/1083] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:39:44 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 20511 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:39:44.500513 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-ed245ddc-7c4f-44e3-9267-a69546c26e32 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:44.501546 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-ed245ddc-7c4f-44e3-9267-a69546c26e32 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:44.508839 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ed245ddc-7c4f-44e3-9267-a69546c26e32 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:44.509290 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ed245ddc-7c4f-44e3-9267-a69546c26e32 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:44.510075 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ed245ddc-7c4f-44e3-9267-a69546c26e32 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:44.510507 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ed245ddc-7c4f-44e3-9267-a69546c26e32 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:44.573609 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-ed245ddc-7c4f-44e3-9267-a69546c26e32 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 28653 microversion: 2.20 time: 0.077010 Dec 15 13:39:44.574230 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 540/1084] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:39:44 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 28653 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:39:45.466749 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ca186bbe-30b0-4635-95f5-d6f60f1c528b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:45.467768 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ca186bbe-30b0-4635-95f5-d6f60f1c528b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:45.475298 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ca186bbe-30b0-4635-95f5-d6f60f1c528b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:45.475753 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ca186bbe-30b0-4635-95f5-d6f60f1c528b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:45.476537 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ca186bbe-30b0-4635-95f5-d6f60f1c528b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:45.476972 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ca186bbe-30b0-4635-95f5-d6f60f1c528b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:45.546736 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ca186bbe-30b0-4635-95f5-d6f60f1c528b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 22835 microversion: 2.1 time: 0.083791 Dec 15 13:39:45.547626 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 545/1085] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:39:45 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 22835 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:39:45.586164 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-859ef18b-9270-4410-978d-74c66212383a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:45.587376 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-859ef18b-9270-4410-978d-74c66212383a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:45.594221 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-859ef18b-9270-4410-978d-74c66212383a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:45.594681 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-859ef18b-9270-4410-978d-74c66212383a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:45.595496 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-859ef18b-9270-4410-978d-74c66212383a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:45.595973 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-859ef18b-9270-4410-978d-74c66212383a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:45.655826 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-859ef18b-9270-4410-978d-74c66212383a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 28653 microversion: 2.20 time: 0.074264 Dec 15 13:39:45.658198 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 541/1086] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:39:45 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 28653 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:39:46.559048 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-1408ebd8-33e5-4f14-b33f-49d28f7920fb tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:46.560046 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-1408ebd8-33e5-4f14-b33f-49d28f7920fb tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:46.566869 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1408ebd8-33e5-4f14-b33f-49d28f7920fb tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:46.567342 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1408ebd8-33e5-4f14-b33f-49d28f7920fb tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:46.568124 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1408ebd8-33e5-4f14-b33f-49d28f7920fb tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:46.568564 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1408ebd8-33e5-4f14-b33f-49d28f7920fb tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:46.652653 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-1408ebd8-33e5-4f14-b33f-49d28f7920fb tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 23798 microversion: 2.1 time: 0.097556 Dec 15 13:39:46.653470 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 546/1087] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:39:46 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 23798 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:39:46.668071 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-dc6f2ff3-7292-4de2-b3d8-5b60f70b4243 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:46.669075 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-dc6f2ff3-7292-4de2-b3d8-5b60f70b4243 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:46.675945 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-dc6f2ff3-7292-4de2-b3d8-5b60f70b4243 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:46.676396 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-dc6f2ff3-7292-4de2-b3d8-5b60f70b4243 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:46.677167 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-dc6f2ff3-7292-4de2-b3d8-5b60f70b4243 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:46.677633 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-dc6f2ff3-7292-4de2-b3d8-5b60f70b4243 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:46.738239 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-dc6f2ff3-7292-4de2-b3d8-5b60f70b4243 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 28653 microversion: 2.20 time: 0.074094 Dec 15 13:39:46.738937 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 542/1088] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:39:46 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 28653 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:39:47.664569 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-6a0f19d4-be41-4c98-8094-ae81c2baf85e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:47.665559 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-6a0f19d4-be41-4c98-8094-ae81c2baf85e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:47.672287 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6a0f19d4-be41-4c98-8094-ae81c2baf85e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:47.672736 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6a0f19d4-be41-4c98-8094-ae81c2baf85e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:47.673515 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6a0f19d4-be41-4c98-8094-ae81c2baf85e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:47.673948 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6a0f19d4-be41-4c98-8094-ae81c2baf85e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:47.744442 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-6a0f19d4-be41-4c98-8094-ae81c2baf85e tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 25581 microversion: 2.1 time: 0.083679 Dec 15 13:39:47.745087 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 547/1089] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:39:47 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 25581 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:39:47.749927 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-76e44aab-d227-4a71-ac20-87f4bbc032a2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:47.750983 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-76e44aab-d227-4a71-ac20-87f4bbc032a2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:47.758466 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-76e44aab-d227-4a71-ac20-87f4bbc032a2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:47.758954 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-76e44aab-d227-4a71-ac20-87f4bbc032a2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:47.759735 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-76e44aab-d227-4a71-ac20-87f4bbc032a2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:47.760170 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-76e44aab-d227-4a71-ac20-87f4bbc032a2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:47.819832 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-76e44aab-d227-4a71-ac20-87f4bbc032a2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 28653 microversion: 2.20 time: 0.073814 Dec 15 13:39:47.820481 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 543/1090] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:39:47 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 28653 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:39:48.756813 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-64a831ad-be58-42b0-80e6-9a943f169a01 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:48.757734 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-64a831ad-be58-42b0-80e6-9a943f169a01 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:48.766713 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-64a831ad-be58-42b0-80e6-9a943f169a01 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:48.767743 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-64a831ad-be58-42b0-80e6-9a943f169a01 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:48.768727 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-64a831ad-be58-42b0-80e6-9a943f169a01 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:48.769223 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-64a831ad-be58-42b0-80e6-9a943f169a01 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:48.832021 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-993cadd1-460a-4e3e-981a-96328060843c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:48.833048 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-993cadd1-460a-4e3e-981a-96328060843c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:48.840416 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-993cadd1-460a-4e3e-981a-96328060843c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:48.840871 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-993cadd1-460a-4e3e-981a-96328060843c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:48.841652 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-993cadd1-460a-4e3e-981a-96328060843c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:48.842091 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-993cadd1-460a-4e3e-981a-96328060843c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:48.849387 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-64a831ad-be58-42b0-80e6-9a943f169a01 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 26902 microversion: 2.1 time: 0.096918 Dec 15 13:39:48.850033 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 548/1091] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:39:48 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 26902 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:39:48.912433 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-993cadd1-460a-4e3e-981a-96328060843c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 28653 microversion: 2.20 time: 0.084489 Dec 15 13:39:48.913097 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 544/1092] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:39:48 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 28653 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:39:49.861554 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-4e690150-7356-4b1a-9a27-a2945b064027 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:49.862579 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-4e690150-7356-4b1a-9a27-a2945b064027 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:49.870332 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4e690150-7356-4b1a-9a27-a2945b064027 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:49.870785 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4e690150-7356-4b1a-9a27-a2945b064027 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:49.871591 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4e690150-7356-4b1a-9a27-a2945b064027 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:49.872025 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4e690150-7356-4b1a-9a27-a2945b064027 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:49.924952 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-5ae30b11-4b7b-4e9f-8052-bf4cb3317f5d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:49.925961 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-5ae30b11-4b7b-4e9f-8052-bf4cb3317f5d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:49.933084 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5ae30b11-4b7b-4e9f-8052-bf4cb3317f5d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:49.933544 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5ae30b11-4b7b-4e9f-8052-bf4cb3317f5d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:49.934337 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5ae30b11-4b7b-4e9f-8052-bf4cb3317f5d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:49.934984 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5ae30b11-4b7b-4e9f-8052-bf4cb3317f5d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:49.946954 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-4e690150-7356-4b1a-9a27-a2945b064027 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 27637 microversion: 2.1 time: 0.088831 Dec 15 13:39:49.948398 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 549/1093] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:39:49 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 27637 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:39:49.996906 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-5ae30b11-4b7b-4e9f-8052-bf4cb3317f5d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 28653 microversion: 2.20 time: 0.075867 Dec 15 13:39:50.000780 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 545/1094] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:39:49 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 28653 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:39:50.959588 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-1b1e87b9-a926-4dfe-a975-f15042d06f07 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:50.960541 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-1b1e87b9-a926-4dfe-a975-f15042d06f07 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:50.967362 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1b1e87b9-a926-4dfe-a975-f15042d06f07 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:50.967812 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1b1e87b9-a926-4dfe-a975-f15042d06f07 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:50.968586 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1b1e87b9-a926-4dfe-a975-f15042d06f07 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:50.969017 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-1b1e87b9-a926-4dfe-a975-f15042d06f07 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:51.009654 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-20c48b14-06dc-4826-92b0-dbf56bd4a19d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:51.010659 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-20c48b14-06dc-4826-92b0-dbf56bd4a19d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:51.017493 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-20c48b14-06dc-4826-92b0-dbf56bd4a19d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:51.017950 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-20c48b14-06dc-4826-92b0-dbf56bd4a19d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:51.018772 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-20c48b14-06dc-4826-92b0-dbf56bd4a19d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:51.019243 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-20c48b14-06dc-4826-92b0-dbf56bd4a19d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:51.042145 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-1b1e87b9-a926-4dfe-a975-f15042d06f07 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 27889 microversion: 2.1 time: 0.086625 Dec 15 13:39:51.042956 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 550/1095] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:39:50 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 27889 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:39:51.085258 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-20c48b14-06dc-4826-92b0-dbf56bd4a19d tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 28653 microversion: 2.20 time: 0.080206 Dec 15 13:39:51.085914 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 546/1096] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:39:51 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 28653 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:39:52.053982 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-2b8b2434-a1a6-42dc-afec-251df6ec4ff8 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:52.055026 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-2b8b2434-a1a6-42dc-afec-251df6ec4ff8 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:52.061794 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2b8b2434-a1a6-42dc-afec-251df6ec4ff8 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:52.062243 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2b8b2434-a1a6-42dc-afec-251df6ec4ff8 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:52.063109 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2b8b2434-a1a6-42dc-afec-251df6ec4ff8 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:52.063547 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2b8b2434-a1a6-42dc-afec-251df6ec4ff8 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:52.097304 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-0eb1c9d2-0df3-4984-8cce-79c1955f5405 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:52.098306 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-0eb1c9d2-0df3-4984-8cce-79c1955f5405 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:52.105154 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0eb1c9d2-0df3-4984-8cce-79c1955f5405 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:52.105613 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0eb1c9d2-0df3-4984-8cce-79c1955f5405 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:52.106399 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0eb1c9d2-0df3-4984-8cce-79c1955f5405 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:52.106839 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0eb1c9d2-0df3-4984-8cce-79c1955f5405 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:52.135667 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-2b8b2434-a1a6-42dc-afec-251df6ec4ff8 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 28185 microversion: 2.1 time: 0.085548 Dec 15 13:39:52.136327 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 551/1097] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:39:52 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 28185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:39:52.169455 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-0eb1c9d2-0df3-4984-8cce-79c1955f5405 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 28653 microversion: 2.20 time: 0.076068 Dec 15 13:39:52.170310 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 547/1098] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:39:52 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 28653 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:39:53.148244 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-517a6997-8b0d-4344-8f7c-972620503ec0 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:53.149237 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-517a6997-8b0d-4344-8f7c-972620503ec0 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:53.156239 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-517a6997-8b0d-4344-8f7c-972620503ec0 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:53.156685 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-517a6997-8b0d-4344-8f7c-972620503ec0 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:53.157465 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-517a6997-8b0d-4344-8f7c-972620503ec0 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:53.157901 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-517a6997-8b0d-4344-8f7c-972620503ec0 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:53.181406 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-7fa877b5-dc14-402d-a8f1-8bf311deca19 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:53.182398 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-7fa877b5-dc14-402d-a8f1-8bf311deca19 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:53.189261 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7fa877b5-dc14-402d-a8f1-8bf311deca19 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:53.189729 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7fa877b5-dc14-402d-a8f1-8bf311deca19 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:53.190521 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7fa877b5-dc14-402d-a8f1-8bf311deca19 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:53.190986 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7fa877b5-dc14-402d-a8f1-8bf311deca19 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:53.222688 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-517a6997-8b0d-4344-8f7c-972620503ec0 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 28185 microversion: 2.1 time: 0.078815 Dec 15 13:39:53.223381 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 552/1099] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:39:53 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 28185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:39:53.249520 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-7fa877b5-dc14-402d-a8f1-8bf311deca19 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 28653 microversion: 2.20 time: 0.072024 Dec 15 13:39:53.250145 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 548/1100] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:39:53 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 28653 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:39:54.235586 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-b240b220-c491-48d4-b5e7-730e45083d68 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:54.236618 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-b240b220-c491-48d4-b5e7-730e45083d68 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:54.244096 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b240b220-c491-48d4-b5e7-730e45083d68 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:54.244557 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b240b220-c491-48d4-b5e7-730e45083d68 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:54.245348 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b240b220-c491-48d4-b5e7-730e45083d68 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:54.245793 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b240b220-c491-48d4-b5e7-730e45083d68 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:54.261436 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-cc22139f-5ee6-4f19-9f28-b37df7acba16 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:54.262438 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-cc22139f-5ee6-4f19-9f28-b37df7acba16 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:54.269345 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cc22139f-5ee6-4f19-9f28-b37df7acba16 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:54.269799 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cc22139f-5ee6-4f19-9f28-b37df7acba16 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:54.270589 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cc22139f-5ee6-4f19-9f28-b37df7acba16 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:54.271071 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cc22139f-5ee6-4f19-9f28-b37df7acba16 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:54.304822 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-b240b220-c491-48d4-b5e7-730e45083d68 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 28185 microversion: 2.1 time: 0.073258 Dec 15 13:39:54.305503 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 553/1101] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:39:54 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 28185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:39:54.338030 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-cc22139f-5ee6-4f19-9f28-b37df7acba16 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 28653 microversion: 2.20 time: 0.080438 Dec 15 13:39:54.338665 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 549/1102] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:39:54 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 28653 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:39:55.316861 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-d045fca5-93b7-4162-85a2-828d12fb1d38 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:55.317856 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-d045fca5-93b7-4162-85a2-828d12fb1d38 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:55.324714 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d045fca5-93b7-4162-85a2-828d12fb1d38 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:55.325171 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d045fca5-93b7-4162-85a2-828d12fb1d38 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:55.325952 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d045fca5-93b7-4162-85a2-828d12fb1d38 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:55.326395 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d045fca5-93b7-4162-85a2-828d12fb1d38 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:55.349886 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-d929d241-f8e3-4380-b571-c2c1056f48a6 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:55.351431 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-d929d241-f8e3-4380-b571-c2c1056f48a6 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:55.359194 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d929d241-f8e3-4380-b571-c2c1056f48a6 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:55.359642 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d929d241-f8e3-4380-b571-c2c1056f48a6 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:55.360419 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d929d241-f8e3-4380-b571-c2c1056f48a6 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:55.360851 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d929d241-f8e3-4380-b571-c2c1056f48a6 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:55.398574 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-d045fca5-93b7-4162-85a2-828d12fb1d38 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 28185 microversion: 2.1 time: 0.085557 Dec 15 13:39:55.399255 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 554/1103] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:39:55 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 28185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:39:55.423363 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-d929d241-f8e3-4380-b571-c2c1056f48a6 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 28653 microversion: 2.20 time: 0.077333 Dec 15 13:39:55.424033 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 550/1104] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:39:55 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 28653 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:39:56.410542 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-3da18037-2194-4d85-839e-2949169e0f77 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:56.411578 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-3da18037-2194-4d85-839e-2949169e0f77 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:56.418461 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3da18037-2194-4d85-839e-2949169e0f77 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:56.418952 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3da18037-2194-4d85-839e-2949169e0f77 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:56.419742 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3da18037-2194-4d85-839e-2949169e0f77 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:56.420189 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3da18037-2194-4d85-839e-2949169e0f77 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:56.435152 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-326592f9-6e81-416f-a034-ca684fcab738 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:56.436141 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-326592f9-6e81-416f-a034-ca684fcab738 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:56.443207 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-326592f9-6e81-416f-a034-ca684fcab738 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:56.444220 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-326592f9-6e81-416f-a034-ca684fcab738 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:56.444997 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-326592f9-6e81-416f-a034-ca684fcab738 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:56.445432 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-326592f9-6e81-416f-a034-ca684fcab738 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:56.483223 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-3da18037-2194-4d85-839e-2949169e0f77 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 28185 microversion: 2.1 time: 0.076464 Dec 15 13:39:56.483883 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 555/1105] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:39:56 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 28185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:39:56.509851 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-326592f9-6e81-416f-a034-ca684fcab738 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 28653 microversion: 2.20 time: 0.078533 Dec 15 13:39:56.510505 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 551/1106] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:39:56 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 28653 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:39:57.495120 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ffdca832-c22b-4ed9-8634-c95d9bda42d4 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:57.496112 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ffdca832-c22b-4ed9-8634-c95d9bda42d4 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:57.502780 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ffdca832-c22b-4ed9-8634-c95d9bda42d4 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:57.503264 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ffdca832-c22b-4ed9-8634-c95d9bda42d4 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:57.504043 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ffdca832-c22b-4ed9-8634-c95d9bda42d4 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:57.504475 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ffdca832-c22b-4ed9-8634-c95d9bda42d4 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:57.522353 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-98c9a0bf-d74f-46ae-84dc-180f77712e3e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:57.523407 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-98c9a0bf-d74f-46ae-84dc-180f77712e3e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:57.530939 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-98c9a0bf-d74f-46ae-84dc-180f77712e3e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:57.531411 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-98c9a0bf-d74f-46ae-84dc-180f77712e3e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:57.532388 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-98c9a0bf-d74f-46ae-84dc-180f77712e3e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:57.532838 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-98c9a0bf-d74f-46ae-84dc-180f77712e3e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:57.569763 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ffdca832-c22b-4ed9-8634-c95d9bda42d4 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 28185 microversion: 2.1 time: 0.078519 Dec 15 13:39:57.570794 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 556/1107] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:39:57 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 28185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:39:57.593417 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-98c9a0bf-d74f-46ae-84dc-180f77712e3e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 28653 microversion: 2.20 time: 0.075529 Dec 15 13:39:57.594041 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 552/1108] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:39:57 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 28653 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:39:58.581642 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ab309ea8-e037-42c0-90dc-cff3a6a5a849 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:58.582683 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ab309ea8-e037-42c0-90dc-cff3a6a5a849 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:58.589556 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ab309ea8-e037-42c0-90dc-cff3a6a5a849 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:58.590014 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ab309ea8-e037-42c0-90dc-cff3a6a5a849 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:58.590799 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ab309ea8-e037-42c0-90dc-cff3a6a5a849 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:58.591265 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ab309ea8-e037-42c0-90dc-cff3a6a5a849 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:58.605828 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-475c3e03-ad14-471a-9fb6-3419f974a15e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:58.606828 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-475c3e03-ad14-471a-9fb6-3419f974a15e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:58.613622 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-475c3e03-ad14-471a-9fb6-3419f974a15e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:58.614082 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-475c3e03-ad14-471a-9fb6-3419f974a15e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:58.614888 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-475c3e03-ad14-471a-9fb6-3419f974a15e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:58.615329 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-475c3e03-ad14-471a-9fb6-3419f974a15e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:58.656683 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ab309ea8-e037-42c0-90dc-cff3a6a5a849 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 28185 microversion: 2.1 time: 0.079175 Dec 15 13:39:58.657356 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 557/1109] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:39:58 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 28185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:39:58.685355 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-475c3e03-ad14-471a-9fb6-3419f974a15e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 28653 microversion: 2.20 time: 0.083341 Dec 15 13:39:58.686203 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 553/1110] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:39:58 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 28653 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:39:59.669191 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-e32f927d-d40d-44f9-b791-04a40145820c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:59.670201 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-e32f927d-d40d-44f9-b791-04a40145820c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:59.677040 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e32f927d-d40d-44f9-b791-04a40145820c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:59.677495 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e32f927d-d40d-44f9-b791-04a40145820c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:59.678786 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e32f927d-d40d-44f9-b791-04a40145820c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:59.679260 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e32f927d-d40d-44f9-b791-04a40145820c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:59.697919 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-569750b3-4f10-47e2-86bb-70710d649d58 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:59.698945 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-569750b3-4f10-47e2-86bb-70710d649d58 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:59.705918 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-569750b3-4f10-47e2-86bb-70710d649d58 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:59.706368 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-569750b3-4f10-47e2-86bb-70710d649d58 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:59.707194 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-569750b3-4f10-47e2-86bb-70710d649d58 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:59.707631 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-569750b3-4f10-47e2-86bb-70710d649d58 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:59.742553 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-e32f927d-d40d-44f9-b791-04a40145820c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 28185 microversion: 2.1 time: 0.077246 Dec 15 13:39:59.743333 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 558/1111] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:39:59 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 28185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:39:59.779578 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-569750b3-4f10-47e2-86bb-70710d649d58 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 28653 microversion: 2.20 time: 0.086051 Dec 15 13:39:59.780154 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 554/1112] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:39:59 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 28653 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:40:00.755068 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-68719cb5-6b3e-4cba-970c-4e2db031472b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:00.757233 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-68719cb5-6b3e-4cba-970c-4e2db031472b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:00.763497 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-68719cb5-6b3e-4cba-970c-4e2db031472b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:00.763962 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-68719cb5-6b3e-4cba-970c-4e2db031472b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:00.764750 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-68719cb5-6b3e-4cba-970c-4e2db031472b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:00.765199 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-68719cb5-6b3e-4cba-970c-4e2db031472b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:00.792040 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-3e37a5e8-263e-41a6-8bd3-3ebd6948feb9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:00.793046 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-3e37a5e8-263e-41a6-8bd3-3ebd6948feb9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:00.799962 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3e37a5e8-263e-41a6-8bd3-3ebd6948feb9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:00.800414 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3e37a5e8-263e-41a6-8bd3-3ebd6948feb9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:00.801204 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3e37a5e8-263e-41a6-8bd3-3ebd6948feb9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:00.801645 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3e37a5e8-263e-41a6-8bd3-3ebd6948feb9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:00.826531 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-68719cb5-6b3e-4cba-970c-4e2db031472b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 28185 microversion: 2.1 time: 0.075414 Dec 15 13:40:00.827713 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 559/1113] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:40:00 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 28185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:40:00.870367 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-3e37a5e8-263e-41a6-8bd3-3ebd6948feb9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 28653 microversion: 2.20 time: 0.082958 Dec 15 13:40:00.871031 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 555/1114] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:40:00 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 28653 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:40:01.839511 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-f784655c-0e04-4e11-982e-ee4be1507318 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:01.840512 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-f784655c-0e04-4e11-982e-ee4be1507318 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:01.847340 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f784655c-0e04-4e11-982e-ee4be1507318 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:01.847794 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f784655c-0e04-4e11-982e-ee4be1507318 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:01.848577 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f784655c-0e04-4e11-982e-ee4be1507318 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:01.849011 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f784655c-0e04-4e11-982e-ee4be1507318 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:01.881892 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-4dcb0605-9562-4c90-8b5b-4be65fd3d6fd tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:01.882923 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-4dcb0605-9562-4c90-8b5b-4be65fd3d6fd tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:01.889765 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4dcb0605-9562-4c90-8b5b-4be65fd3d6fd tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:01.890217 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4dcb0605-9562-4c90-8b5b-4be65fd3d6fd tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:01.891042 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4dcb0605-9562-4c90-8b5b-4be65fd3d6fd tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:01.891485 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4dcb0605-9562-4c90-8b5b-4be65fd3d6fd tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:01.906833 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-f784655c-0e04-4e11-982e-ee4be1507318 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 28185 microversion: 2.1 time: 0.071885 Dec 15 13:40:01.910771 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 560/1115] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:40:01 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 28185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:40:01.953396 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-4dcb0605-9562-4c90-8b5b-4be65fd3d6fd tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 28653 microversion: 2.20 time: 0.075796 Dec 15 13:40:01.954203 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 556/1116] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:40:01 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 28653 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:40:02.918936 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-90522def-a63a-4aa5-b8bf-722442b23bff tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:02.919953 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-90522def-a63a-4aa5-b8bf-722442b23bff tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:02.926756 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-90522def-a63a-4aa5-b8bf-722442b23bff tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:02.927245 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-90522def-a63a-4aa5-b8bf-722442b23bff tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:02.928031 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-90522def-a63a-4aa5-b8bf-722442b23bff tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:02.930840 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-90522def-a63a-4aa5-b8bf-722442b23bff tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:02.965169 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-ee9c67d7-3e04-4615-8453-0b84f7f6025b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:02.966176 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-ee9c67d7-3e04-4615-8453-0b84f7f6025b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:02.973031 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ee9c67d7-3e04-4615-8453-0b84f7f6025b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:02.973486 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ee9c67d7-3e04-4615-8453-0b84f7f6025b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:02.974271 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ee9c67d7-3e04-4615-8453-0b84f7f6025b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:02.974714 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ee9c67d7-3e04-4615-8453-0b84f7f6025b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:02.993888 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-90522def-a63a-4aa5-b8bf-722442b23bff tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 28185 microversion: 2.1 time: 0.078832 Dec 15 13:40:02.997736 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 561/1117] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:40:02 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 28185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:40:03.049309 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-ee9c67d7-3e04-4615-8453-0b84f7f6025b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 29177 microversion: 2.20 time: 0.088112 Dec 15 13:40:03.049946 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 557/1118] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:40:02 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 29177 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:40:04.005881 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-62c6e520-c380-43c8-b83c-022d3b45dbec tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:04.007429 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-62c6e520-c380-43c8-b83c-022d3b45dbec tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:04.014216 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-62c6e520-c380-43c8-b83c-022d3b45dbec tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:04.014673 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-62c6e520-c380-43c8-b83c-022d3b45dbec tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:04.015491 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-62c6e520-c380-43c8-b83c-022d3b45dbec tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:04.015929 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-62c6e520-c380-43c8-b83c-022d3b45dbec tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:04.061170 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-a5b18e38-a6e6-45cf-bbee-e7f2261875f4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:04.062351 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-a5b18e38-a6e6-45cf-bbee-e7f2261875f4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:04.069692 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a5b18e38-a6e6-45cf-bbee-e7f2261875f4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:04.070144 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a5b18e38-a6e6-45cf-bbee-e7f2261875f4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:04.070959 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a5b18e38-a6e6-45cf-bbee-e7f2261875f4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:04.071398 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a5b18e38-a6e6-45cf-bbee-e7f2261875f4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:04.077964 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-62c6e520-c380-43c8-b83c-022d3b45dbec tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 28185 microversion: 2.1 time: 0.075957 Dec 15 13:40:04.082098 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 562/1119] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:40:04 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 28185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:40:04.148713 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-a5b18e38-a6e6-45cf-bbee-e7f2261875f4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 31261 microversion: 2.20 time: 0.091440 Dec 15 13:40:04.149349 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 558/1120] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:40:04 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 31261 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:40:05.090520 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-0848449c-86d3-4be4-8173-0e601fdb0b7b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:05.091561 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-0848449c-86d3-4be4-8173-0e601fdb0b7b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:05.098516 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0848449c-86d3-4be4-8173-0e601fdb0b7b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:05.099011 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0848449c-86d3-4be4-8173-0e601fdb0b7b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:05.099805 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0848449c-86d3-4be4-8173-0e601fdb0b7b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:05.100886 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0848449c-86d3-4be4-8173-0e601fdb0b7b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:05.160942 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-8760661a-7ee4-4bdc-9c66-6fa1ffc51f1b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:05.161983 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-8760661a-7ee4-4bdc-9c66-6fa1ffc51f1b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:05.167912 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-0848449c-86d3-4be4-8173-0e601fdb0b7b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 28185 microversion: 2.1 time: 0.081284 Dec 15 13:40:05.171742 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 563/1121] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:40:05 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 28185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:40:05.171895 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8760661a-7ee4-4bdc-9c66-6fa1ffc51f1b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:05.171895 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8760661a-7ee4-4bdc-9c66-6fa1ffc51f1b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:05.171895 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8760661a-7ee4-4bdc-9c66-6fa1ffc51f1b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:05.171895 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8760661a-7ee4-4bdc-9c66-6fa1ffc51f1b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:05.242446 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-8760661a-7ee4-4bdc-9c66-6fa1ffc51f1b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 32857 microversion: 2.20 time: 0.085459 Dec 15 13:40:05.243121 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 559/1122] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:40:05 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 32857 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:40:06.179753 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-333db71f-8a0e-45ee-a7f5-3b942bfc0c1a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:06.180758 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-333db71f-8a0e-45ee-a7f5-3b942bfc0c1a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:06.187560 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-333db71f-8a0e-45ee-a7f5-3b942bfc0c1a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:06.188015 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-333db71f-8a0e-45ee-a7f5-3b942bfc0c1a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:06.188795 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-333db71f-8a0e-45ee-a7f5-3b942bfc0c1a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:06.189235 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-333db71f-8a0e-45ee-a7f5-3b942bfc0c1a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:06.254769 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-9a670e5d-a620-4f2d-a175-9ae11988ec18 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:06.255805 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-9a670e5d-a620-4f2d-a175-9ae11988ec18 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:06.262614 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9a670e5d-a620-4f2d-a175-9ae11988ec18 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:06.263108 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9a670e5d-a620-4f2d-a175-9ae11988ec18 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:06.263898 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9a670e5d-a620-4f2d-a175-9ae11988ec18 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:06.264343 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9a670e5d-a620-4f2d-a175-9ae11988ec18 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:06.268910 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-333db71f-8a0e-45ee-a7f5-3b942bfc0c1a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 28476 microversion: 2.1 time: 0.093762 Dec 15 13:40:06.269799 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 564/1123] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:40:06 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 28476 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:40:06.362732 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-9a670e5d-a620-4f2d-a175-9ae11988ec18 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 33902 microversion: 2.20 time: 0.111922 Dec 15 13:40:06.363397 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 560/1124] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:40:06 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 33902 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:40:07.281014 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-bb3c991c-2cd7-4c28-9610-8bf3aec7f350 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:07.282013 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-bb3c991c-2cd7-4c28-9610-8bf3aec7f350 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:07.288955 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-bb3c991c-2cd7-4c28-9610-8bf3aec7f350 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:07.289413 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-bb3c991c-2cd7-4c28-9610-8bf3aec7f350 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:07.290200 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-bb3c991c-2cd7-4c28-9610-8bf3aec7f350 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:07.290639 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-bb3c991c-2cd7-4c28-9610-8bf3aec7f350 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:07.358714 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-bb3c991c-2cd7-4c28-9610-8bf3aec7f350 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 28476 microversion: 2.1 time: 0.081660 Dec 15 13:40:07.359374 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 565/1125] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:40:07 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 28476 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:40:07.375469 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-02f690ec-6972-4966-a316-7d5db2882f35 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:07.376465 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-02f690ec-6972-4966-a316-7d5db2882f35 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:07.383978 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-02f690ec-6972-4966-a316-7d5db2882f35 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:07.384429 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-02f690ec-6972-4966-a316-7d5db2882f35 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:07.385206 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-02f690ec-6972-4966-a316-7d5db2882f35 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:07.385644 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-02f690ec-6972-4966-a316-7d5db2882f35 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:07.455010 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-02f690ec-6972-4966-a316-7d5db2882f35 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 35076 microversion: 2.20 time: 0.083268 Dec 15 13:40:07.455681 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 561/1126] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:40:07 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 35076 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:40:08.370327 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-9ecb8533-2598-4198-be70-38ee92676b41 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:08.371340 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-9ecb8533-2598-4198-be70-38ee92676b41 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:08.378083 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9ecb8533-2598-4198-be70-38ee92676b41 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:08.378536 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9ecb8533-2598-4198-be70-38ee92676b41 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:08.379345 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9ecb8533-2598-4198-be70-38ee92676b41 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:08.379781 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9ecb8533-2598-4198-be70-38ee92676b41 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:08.453974 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-9ecb8533-2598-4198-be70-38ee92676b41 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 28644 microversion: 2.1 time: 0.087518 Dec 15 13:40:08.454901 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 566/1127] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:40:08 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 28644 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:40:08.467841 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-cfca8444-60fb-4ef5-9c34-dae0305254c5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:08.468855 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-cfca8444-60fb-4ef5-9c34-dae0305254c5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:08.475815 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cfca8444-60fb-4ef5-9c34-dae0305254c5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:08.476270 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cfca8444-60fb-4ef5-9c34-dae0305254c5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:08.477055 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cfca8444-60fb-4ef5-9c34-dae0305254c5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:08.477496 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cfca8444-60fb-4ef5-9c34-dae0305254c5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:08.565923 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-cfca8444-60fb-4ef5-9c34-dae0305254c5 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 36260 microversion: 2.20 time: 0.102059 Dec 15 13:40:08.566587 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 562/1128] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:40:08 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 36260 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:40:09.466486 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ea06c0d4-cee4-472f-9262-0c3b01316863 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:09.467508 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ea06c0d4-cee4-472f-9262-0c3b01316863 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:09.474321 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ea06c0d4-cee4-472f-9262-0c3b01316863 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:09.474778 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ea06c0d4-cee4-472f-9262-0c3b01316863 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:09.476281 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ea06c0d4-cee4-472f-9262-0c3b01316863 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:09.476726 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ea06c0d4-cee4-472f-9262-0c3b01316863 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:09.536861 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ea06c0d4-cee4-472f-9262-0c3b01316863 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 28644 microversion: 2.1 time: 0.074332 Dec 15 13:40:09.537483 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 567/1129] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:40:09 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 28644 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:40:09.578405 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-b51329bd-74d2-4990-a31e-6a12822ae593 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:09.579763 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-b51329bd-74d2-4990-a31e-6a12822ae593 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:09.587054 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b51329bd-74d2-4990-a31e-6a12822ae593 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:09.587508 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b51329bd-74d2-4990-a31e-6a12822ae593 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:09.588295 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b51329bd-74d2-4990-a31e-6a12822ae593 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:09.588729 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b51329bd-74d2-4990-a31e-6a12822ae593 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:09.669535 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-b51329bd-74d2-4990-a31e-6a12822ae593 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 37892 microversion: 2.20 time: 0.094966 Dec 15 13:40:09.670192 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 563/1130] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:40:09 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 37892 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:40:10.549364 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-f254ddeb-e126-4328-b169-f45f227ec678 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:10.550359 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-f254ddeb-e126-4328-b169-f45f227ec678 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:10.557902 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f254ddeb-e126-4328-b169-f45f227ec678 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:10.558358 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f254ddeb-e126-4328-b169-f45f227ec678 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:10.559181 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f254ddeb-e126-4328-b169-f45f227ec678 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:10.559621 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f254ddeb-e126-4328-b169-f45f227ec678 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:10.621098 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-f254ddeb-e126-4328-b169-f45f227ec678 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 28644 microversion: 2.1 time: 0.075592 Dec 15 13:40:10.621993 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 568/1131] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:40:10 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 28644 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:40:10.682550 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-f19f1138-a7ac-4c6f-ae23-acddd2a82dbf tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:10.683580 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-f19f1138-a7ac-4c6f-ae23-acddd2a82dbf tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:10.690475 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f19f1138-a7ac-4c6f-ae23-acddd2a82dbf tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:10.690952 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f19f1138-a7ac-4c6f-ae23-acddd2a82dbf tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:10.692042 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f19f1138-a7ac-4c6f-ae23-acddd2a82dbf tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:10.692177 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f19f1138-a7ac-4c6f-ae23-acddd2a82dbf tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:10.773095 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-f19f1138-a7ac-4c6f-ae23-acddd2a82dbf tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 38212 microversion: 2.20 time: 0.095014 Dec 15 13:40:10.773747 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 564/1132] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:40:10 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 38212 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:40:11.633608 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-0e29728c-9a75-46d4-9d0e-262ee10bd1ba tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:11.634597 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-0e29728c-9a75-46d4-9d0e-262ee10bd1ba tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:11.641404 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0e29728c-9a75-46d4-9d0e-262ee10bd1ba tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:11.641856 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0e29728c-9a75-46d4-9d0e-262ee10bd1ba tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:11.642642 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0e29728c-9a75-46d4-9d0e-262ee10bd1ba tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:11.643108 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0e29728c-9a75-46d4-9d0e-262ee10bd1ba tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:11.708332 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-0e29728c-9a75-46d4-9d0e-262ee10bd1ba tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 28644 microversion: 2.1 time: 0.079153 Dec 15 13:40:11.708969 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 569/1133] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:40:11 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 28644 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:40:11.785562 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-9507939b-ddeb-4dde-903d-55c1049588f9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:11.786569 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-9507939b-ddeb-4dde-903d-55c1049588f9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:11.793456 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9507939b-ddeb-4dde-903d-55c1049588f9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:11.793903 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9507939b-ddeb-4dde-903d-55c1049588f9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:11.794689 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9507939b-ddeb-4dde-903d-55c1049588f9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:11.795160 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9507939b-ddeb-4dde-903d-55c1049588f9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:11.859551 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-9507939b-ddeb-4dde-903d-55c1049588f9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 38212 microversion: 2.20 time: 0.078030 Dec 15 13:40:11.860476 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 565/1134] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:40:11 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 38212 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:40:12.720413 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-b549b676-b546-4f15-8de2-e15595752d43 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:12.721447 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-b549b676-b546-4f15-8de2-e15595752d43 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:12.728291 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b549b676-b546-4f15-8de2-e15595752d43 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:12.728753 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b549b676-b546-4f15-8de2-e15595752d43 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:12.729534 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b549b676-b546-4f15-8de2-e15595752d43 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:12.729977 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b549b676-b546-4f15-8de2-e15595752d43 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:12.792291 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-b549b676-b546-4f15-8de2-e15595752d43 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 28644 microversion: 2.1 time: 0.075866 Dec 15 13:40:12.793089 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 570/1135] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:40:12 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 28644 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:40:12.872305 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-0f28f7f9-e493-42e2-971f-c4e42ae41fdb tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:12.873308 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-0f28f7f9-e493-42e2-971f-c4e42ae41fdb tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:12.880146 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0f28f7f9-e493-42e2-971f-c4e42ae41fdb tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:12.880599 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0f28f7f9-e493-42e2-971f-c4e42ae41fdb tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:12.881382 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0f28f7f9-e493-42e2-971f-c4e42ae41fdb tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:12.881820 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0f28f7f9-e493-42e2-971f-c4e42ae41fdb tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:12.944408 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-0f28f7f9-e493-42e2-971f-c4e42ae41fdb tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 38212 microversion: 2.20 time: 0.075964 Dec 15 13:40:12.944964 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 566/1136] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:40:12 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 38212 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:40:13.804627 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-c722d924-7e49-4db5-81bc-7586c92edb8d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:13.806282 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-c722d924-7e49-4db5-81bc-7586c92edb8d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:13.813118 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c722d924-7e49-4db5-81bc-7586c92edb8d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:13.813569 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c722d924-7e49-4db5-81bc-7586c92edb8d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:13.814351 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c722d924-7e49-4db5-81bc-7586c92edb8d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:13.814785 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c722d924-7e49-4db5-81bc-7586c92edb8d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:13.878233 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-c722d924-7e49-4db5-81bc-7586c92edb8d tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 28644 microversion: 2.1 time: 0.077964 Dec 15 13:40:13.878910 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 571/1137] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:40:13 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 28644 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:40:13.957405 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-9ef4a242-3874-4ed9-8a79-e219b1400f82 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:13.958414 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-9ef4a242-3874-4ed9-8a79-e219b1400f82 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:13.965830 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9ef4a242-3874-4ed9-8a79-e219b1400f82 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:13.966288 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9ef4a242-3874-4ed9-8a79-e219b1400f82 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:13.967107 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9ef4a242-3874-4ed9-8a79-e219b1400f82 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:13.967560 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9ef4a242-3874-4ed9-8a79-e219b1400f82 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:14.034937 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-9ef4a242-3874-4ed9-8a79-e219b1400f82 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 38212 microversion: 2.20 time: 0.081793 Dec 15 13:40:14.035835 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 567/1138] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:40:13 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 38212 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:40:14.890115 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-b6db1537-5ff3-46c8-a5b0-852e6d058347 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:14.891135 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-b6db1537-5ff3-46c8-a5b0-852e6d058347 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:14.897889 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b6db1537-5ff3-46c8-a5b0-852e6d058347 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:14.898340 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b6db1537-5ff3-46c8-a5b0-852e6d058347 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:14.899144 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b6db1537-5ff3-46c8-a5b0-852e6d058347 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:14.899580 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b6db1537-5ff3-46c8-a5b0-852e6d058347 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:14.966412 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-b6db1537-5ff3-46c8-a5b0-852e6d058347 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 28644 microversion: 2.1 time: 0.080228 Dec 15 13:40:14.967090 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 572/1139] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:40:14 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 28644 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:40:15.047505 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-e3a2304a-a7eb-4e52-b37f-70003c832ce2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:15.048513 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-e3a2304a-a7eb-4e52-b37f-70003c832ce2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:15.056173 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e3a2304a-a7eb-4e52-b37f-70003c832ce2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:15.056492 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e3a2304a-a7eb-4e52-b37f-70003c832ce2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:15.057272 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e3a2304a-a7eb-4e52-b37f-70003c832ce2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:15.057712 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e3a2304a-a7eb-4e52-b37f-70003c832ce2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:15.130409 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-e3a2304a-a7eb-4e52-b37f-70003c832ce2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 200 len: 38355 microversion: 2.20 time: 0.086873 Dec 15 13:40:15.131090 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 568/1140] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:40:15 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 38355 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:40:15.141405 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-b2df06f7-e807-4f48-a019-ca52ace8f0be tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:15.141991 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-b2df06f7-e807-4f48-a019-ca52ace8f0be tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:15.148896 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b2df06f7-e807-4f48-a019-ca52ace8f0be tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:15.149432 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b2df06f7-e807-4f48-a019-ca52ace8f0be tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:15.150677 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b2df06f7-e807-4f48-a019-ca52ace8f0be tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:15.151451 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b2df06f7-e807-4f48-a019-ca52ace8f0be tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:15.177656 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-b2df06f7-e807-4f48-a019-ca52ace8f0be tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/ips" status: 200 len: 153 microversion: 2.20 time: 0.040258 Dec 15 13:40:15.178233 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 573/1141] 10.222.0.60 () {60 vars in 1288 bytes} [Wed Dec 15 13:40:15 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/ips => generated 153 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:40:15.770772 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-e6489fe8-5ecd-4a0a-9bcf-f07f7000b503 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:15.771407 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-e6489fe8-5ecd-4a0a-9bcf-f07f7000b503 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] [instance: b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:15.778971 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e6489fe8-5ecd-4a0a-9bcf-f07f7000b503 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:15.779419 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e6489fe8-5ecd-4a0a-9bcf-f07f7000b503 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:15.780190 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e6489fe8-5ecd-4a0a-9bcf-f07f7000b503 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:15.780624 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e6489fe8-5ecd-4a0a-9bcf-f07f7000b503 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:15.804412 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.objects.instance [None req-e6489fe8-5ecd-4a0a-9bcf-f07f7000b503 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lazy-loading 'flavor' on Instance uuid b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e {{(pid=116941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:40:15.874073 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-e6489fe8-5ecd-4a0a-9bcf-f07f7000b503 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] 10.222.0.60 "POST /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e/action" status: 202 len: 0 microversion: 2.1 time: 0.107054 Dec 15 13:40:15.874684 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 569/1142] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:40:15 2021] POST /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:40:15.883416 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-6bf97a48-7dba-44dc-a640-6e988d1cf899 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:15.884034 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-6bf97a48-7dba-44dc-a640-6e988d1cf899 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] [instance: b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:15.890380 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6bf97a48-7dba-44dc-a640-6e988d1cf899 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:15.891324 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6bf97a48-7dba-44dc-a640-6e988d1cf899 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:15.891642 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6bf97a48-7dba-44dc-a640-6e988d1cf899 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:15.892166 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6bf97a48-7dba-44dc-a640-6e988d1cf899 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:15.978796 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-9b0b4090-65e8-4dfc-92b0-29fc951d44ac tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:15.979558 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-9b0b4090-65e8-4dfc-92b0-29fc951d44ac tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:15.985643 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9b0b4090-65e8-4dfc-92b0-29fc951d44ac tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:15.986093 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9b0b4090-65e8-4dfc-92b0-29fc951d44ac tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:15.987109 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9b0b4090-65e8-4dfc-92b0-29fc951d44ac tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:15.987546 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9b0b4090-65e8-4dfc-92b0-29fc951d44ac tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:16.032410 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-6bf97a48-7dba-44dc-a640-6e988d1cf899 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7774ea10bce345cabd96a0c94eda98b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ac6d4548e486492887beb2e915bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:16.039776 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-6bf97a48-7dba-44dc-a640-6e988d1cf899 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] 10.222.0.60 "GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e" status: 200 len: 1566 microversion: 2.1 time: 0.160714 Dec 15 13:40:16.040348 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 574/1143] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:15 2021] GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:16.064364 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-9b0b4090-65e8-4dfc-92b0-29fc951d44ac tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 28644 microversion: 2.1 time: 0.089977 Dec 15 13:40:16.065015 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 570/1144] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:40:15 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 28644 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:40:17.056981 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-8023d4be-8ab5-4e95-abfb-1979daac79be tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:17.057628 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-8023d4be-8ab5-4e95-abfb-1979daac79be tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] [instance: b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:17.063967 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8023d4be-8ab5-4e95-abfb-1979daac79be tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:17.064421 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8023d4be-8ab5-4e95-abfb-1979daac79be tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:17.065207 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8023d4be-8ab5-4e95-abfb-1979daac79be tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:17.065651 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8023d4be-8ab5-4e95-abfb-1979daac79be tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:17.076647 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-04afaae4-0766-4ffe-a3d0-c3c924a13f9f tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:17.077651 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-04afaae4-0766-4ffe-a3d0-c3c924a13f9f tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:17.084644 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-04afaae4-0766-4ffe-a3d0-c3c924a13f9f tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:17.085095 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-04afaae4-0766-4ffe-a3d0-c3c924a13f9f tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:17.086388 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-04afaae4-0766-4ffe-a3d0-c3c924a13f9f tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:17.086824 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-04afaae4-0766-4ffe-a3d0-c3c924a13f9f tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:17.149933 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-04afaae4-0766-4ffe-a3d0-c3c924a13f9f tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 28644 microversion: 2.1 time: 0.077114 Dec 15 13:40:17.153834 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 571/1145] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:40:17 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 28644 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:40:17.206085 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-8023d4be-8ab5-4e95-abfb-1979daac79be tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7774ea10bce345cabd96a0c94eda98b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ac6d4548e486492887beb2e915bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:17.213878 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-8023d4be-8ab5-4e95-abfb-1979daac79be tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] 10.222.0.60 "GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e" status: 200 len: 1566 microversion: 2.1 time: 0.160647 Dec 15 13:40:17.214446 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 575/1146] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:17 2021] GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:40:17.408829 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-41cd3a22-0467-4e08-9ca5-7460b35c485b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:17.409363 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-41cd3a22-0467-4e08-9ca5-7460b35c485b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:17.416210 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-41cd3a22-0467-4e08-9ca5-7460b35c485b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:17.416653 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-41cd3a22-0467-4e08-9ca5-7460b35c485b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:17.417424 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-41cd3a22-0467-4e08-9ca5-7460b35c485b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:17.417858 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-41cd3a22-0467-4e08-9ca5-7460b35c485b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:17.439714 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.objects.instance [None req-41cd3a22-0467-4e08-9ca5-7460b35c485b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lazy-loading 'flavor' on Instance uuid f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 {{(pid=116941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:40:17.689431 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-41cd3a22-0467-4e08-9ca5-7460b35c485b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 202 len: 0 microversion: 2.20 time: 0.284747 Dec 15 13:40:17.690379 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 572/1147] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:40:17 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:40:17.698533 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-f3f94b10-04b7-4fbe-a512-e40d417c6a57 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:17.699243 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-f3f94b10-04b7-4fbe-a512-e40d417c6a57 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:17.706130 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f3f94b10-04b7-4fbe-a512-e40d417c6a57 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:17.706586 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f3f94b10-04b7-4fbe-a512-e40d417c6a57 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:17.707612 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f3f94b10-04b7-4fbe-a512-e40d417c6a57 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:17.708123 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f3f94b10-04b7-4fbe-a512-e40d417c6a57 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:17.841268 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-f3f94b10-04b7-4fbe-a512-e40d417c6a57 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:17.848875 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-f3f94b10-04b7-4fbe-a512-e40d417c6a57 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:17.850362 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-f3f94b10-04b7-4fbe-a512-e40d417c6a57 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:17.851547 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-f3f94b10-04b7-4fbe-a512-e40d417c6a57 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 200 len: 1725 microversion: 2.20 time: 0.157369 Dec 15 13:40:17.852124 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 576/1148] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:40:17 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:40:18.162365 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-c7dca8ac-62fe-41fd-a482-1d197dc3672b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:18.163407 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-c7dca8ac-62fe-41fd-a482-1d197dc3672b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:18.169964 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c7dca8ac-62fe-41fd-a482-1d197dc3672b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:18.170407 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c7dca8ac-62fe-41fd-a482-1d197dc3672b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:18.171206 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c7dca8ac-62fe-41fd-a482-1d197dc3672b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:18.171639 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c7dca8ac-62fe-41fd-a482-1d197dc3672b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:18.231258 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-6ef1c714-21e2-452b-836d-4feaf6451528 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:18.231869 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-6ef1c714-21e2-452b-836d-4feaf6451528 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] [instance: b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:18.238029 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6ef1c714-21e2-452b-836d-4feaf6451528 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:18.238480 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6ef1c714-21e2-452b-836d-4feaf6451528 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:18.239816 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6ef1c714-21e2-452b-836d-4feaf6451528 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:18.240430 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6ef1c714-21e2-452b-836d-4feaf6451528 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:18.243454 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-c7dca8ac-62fe-41fd-a482-1d197dc3672b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 28644 microversion: 2.1 time: 0.085692 Dec 15 13:40:18.244339 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 573/1149] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:40:18 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 28644 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:40:18.369552 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-6ef1c714-21e2-452b-836d-4feaf6451528 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7774ea10bce345cabd96a0c94eda98b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ac6d4548e486492887beb2e915bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:18.376724 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-6ef1c714-21e2-452b-836d-4feaf6451528 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] 10.222.0.60 "GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e" status: 200 len: 1566 microversion: 2.1 time: 0.149136 Dec 15 13:40:18.377296 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 577/1150] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:18 2021] GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:40:18.870979 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-26d70a19-3218-416a-bb22-367035ad7aac tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:18.871607 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-26d70a19-3218-416a-bb22-367035ad7aac tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:18.878473 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-26d70a19-3218-416a-bb22-367035ad7aac tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:18.878975 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-26d70a19-3218-416a-bb22-367035ad7aac tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:18.879777 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-26d70a19-3218-416a-bb22-367035ad7aac tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:18.880218 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-26d70a19-3218-416a-bb22-367035ad7aac tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:19.013255 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-26d70a19-3218-416a-bb22-367035ad7aac tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:19.020990 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-26d70a19-3218-416a-bb22-367035ad7aac tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:19.022502 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-26d70a19-3218-416a-bb22-367035ad7aac tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:19.023707 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-26d70a19-3218-416a-bb22-367035ad7aac tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 200 len: 1725 microversion: 2.20 time: 0.157617 Dec 15 13:40:19.024278 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 574/1151] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:40:18 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:40:19.254936 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-0da29070-fb38-459d-ad66-06184dd462a9 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:19.255909 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-0da29070-fb38-459d-ad66-06184dd462a9 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:19.262176 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0da29070-fb38-459d-ad66-06184dd462a9 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:19.262630 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0da29070-fb38-459d-ad66-06184dd462a9 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:19.263442 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0da29070-fb38-459d-ad66-06184dd462a9 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:19.263882 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0da29070-fb38-459d-ad66-06184dd462a9 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:19.329704 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-0da29070-fb38-459d-ad66-06184dd462a9 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 28644 microversion: 2.1 time: 0.078238 Dec 15 13:40:19.330585 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 578/1152] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:40:19 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 28644 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:40:19.393979 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-0691132e-aa15-4eff-a3c5-1835b1085a72 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:19.394592 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-0691132e-aa15-4eff-a3c5-1835b1085a72 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] [instance: b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:19.401421 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0691132e-aa15-4eff-a3c5-1835b1085a72 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:19.401873 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0691132e-aa15-4eff-a3c5-1835b1085a72 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:19.402652 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0691132e-aa15-4eff-a3c5-1835b1085a72 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:19.403120 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0691132e-aa15-4eff-a3c5-1835b1085a72 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:19.536288 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-0691132e-aa15-4eff-a3c5-1835b1085a72 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7774ea10bce345cabd96a0c94eda98b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ac6d4548e486492887beb2e915bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:19.543582 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-0691132e-aa15-4eff-a3c5-1835b1085a72 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] 10.222.0.60 "GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e" status: 200 len: 1566 microversion: 2.1 time: 0.153246 Dec 15 13:40:19.544155 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 575/1153] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:19 2021] GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:20.042910 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-dcbeec40-ac4c-4a66-a815-67eae7072cfb tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:20.043618 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-dcbeec40-ac4c-4a66-a815-67eae7072cfb tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:20.050382 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-dcbeec40-ac4c-4a66-a815-67eae7072cfb tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:20.050886 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-dcbeec40-ac4c-4a66-a815-67eae7072cfb tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:20.051688 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-dcbeec40-ac4c-4a66-a815-67eae7072cfb tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:20.052129 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-dcbeec40-ac4c-4a66-a815-67eae7072cfb tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:20.183640 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-dcbeec40-ac4c-4a66-a815-67eae7072cfb tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:20.191747 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-dcbeec40-ac4c-4a66-a815-67eae7072cfb tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:20.193245 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-dcbeec40-ac4c-4a66-a815-67eae7072cfb tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:20.194400 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-dcbeec40-ac4c-4a66-a815-67eae7072cfb tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 200 len: 1725 microversion: 2.20 time: 0.155663 Dec 15 13:40:20.195540 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 579/1154] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:40:20 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:40:20.341339 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-caffff18-0097-4500-a8d4-67a01e4bb419 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:20.342247 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-caffff18-0097-4500-a8d4-67a01e4bb419 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:20.348460 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-caffff18-0097-4500-a8d4-67a01e4bb419 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:20.348911 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-caffff18-0097-4500-a8d4-67a01e4bb419 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:20.349702 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-caffff18-0097-4500-a8d4-67a01e4bb419 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:20.350141 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-caffff18-0097-4500-a8d4-67a01e4bb419 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:20.420088 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-caffff18-0097-4500-a8d4-67a01e4bb419 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 28644 microversion: 2.1 time: 0.082311 Dec 15 13:40:20.420737 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 576/1155] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:40:20 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 28644 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:40:20.560730 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-61adeae7-91cd-4ba2-9403-0d75080541e4 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:20.561365 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-61adeae7-91cd-4ba2-9403-0d75080541e4 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] [instance: b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:20.567776 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-61adeae7-91cd-4ba2-9403-0d75080541e4 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:20.568228 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-61adeae7-91cd-4ba2-9403-0d75080541e4 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:20.569014 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-61adeae7-91cd-4ba2-9403-0d75080541e4 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:20.569449 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-61adeae7-91cd-4ba2-9403-0d75080541e4 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:20.697842 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-61adeae7-91cd-4ba2-9403-0d75080541e4 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7774ea10bce345cabd96a0c94eda98b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ac6d4548e486492887beb2e915bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:20.705448 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-61adeae7-91cd-4ba2-9403-0d75080541e4 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] 10.222.0.60 "GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e" status: 200 len: 1566 microversion: 2.1 time: 0.148131 Dec 15 13:40:20.706011 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 580/1156] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:20 2021] GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e => generated 1566 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:21.216602 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-54a7f69b-46da-4456-a20a-0e8dd45f71f3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:21.217227 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-54a7f69b-46da-4456-a20a-0e8dd45f71f3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:21.231632 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-54a7f69b-46da-4456-a20a-0e8dd45f71f3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:21.232088 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-54a7f69b-46da-4456-a20a-0e8dd45f71f3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:21.232879 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-54a7f69b-46da-4456-a20a-0e8dd45f71f3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:21.233318 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-54a7f69b-46da-4456-a20a-0e8dd45f71f3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:21.360585 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-54a7f69b-46da-4456-a20a-0e8dd45f71f3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:21.368848 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-54a7f69b-46da-4456-a20a-0e8dd45f71f3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:21.370333 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-54a7f69b-46da-4456-a20a-0e8dd45f71f3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:21.371531 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-54a7f69b-46da-4456-a20a-0e8dd45f71f3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 200 len: 1725 microversion: 2.20 time: 0.161981 Dec 15 13:40:21.372085 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 577/1157] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:40:21 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:40:21.431581 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-b227df1b-dc1a-4cfd-9761-14af11c914de tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:21.432490 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-b227df1b-dc1a-4cfd-9761-14af11c914de tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:21.438602 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b227df1b-dc1a-4cfd-9761-14af11c914de tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:21.439089 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b227df1b-dc1a-4cfd-9761-14af11c914de tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:21.439865 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b227df1b-dc1a-4cfd-9761-14af11c914de tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:21.440300 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b227df1b-dc1a-4cfd-9761-14af11c914de tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:21.509900 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-b227df1b-dc1a-4cfd-9761-14af11c914de tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 28644 microversion: 2.1 time: 0.081764 Dec 15 13:40:21.510469 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 581/1158] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:40:21 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 28644 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:40:21.722673 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-188e1ba7-09b0-4fc6-b1da-b1dd74fd0f3c tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:21.723330 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-188e1ba7-09b0-4fc6-b1da-b1dd74fd0f3c tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] [instance: b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:21.730244 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-188e1ba7-09b0-4fc6-b1da-b1dd74fd0f3c tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:21.730701 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-188e1ba7-09b0-4fc6-b1da-b1dd74fd0f3c tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:21.731528 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-188e1ba7-09b0-4fc6-b1da-b1dd74fd0f3c tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:21.731975 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-188e1ba7-09b0-4fc6-b1da-b1dd74fd0f3c tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:21.869962 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-188e1ba7-09b0-4fc6-b1da-b1dd74fd0f3c tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7774ea10bce345cabd96a0c94eda98b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ac6d4548e486492887beb2e915bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:21.877273 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-188e1ba7-09b0-4fc6-b1da-b1dd74fd0f3c tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] 10.222.0.60 "GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e" status: 200 len: 1566 microversion: 2.1 time: 0.158263 Dec 15 13:40:21.877855 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 578/1159] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:21 2021] GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:40:22.389764 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-5f7da323-209f-44ea-a063-0136f2abed27 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:22.390466 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-5f7da323-209f-44ea-a063-0136f2abed27 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:22.397298 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5f7da323-209f-44ea-a063-0136f2abed27 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:22.397751 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5f7da323-209f-44ea-a063-0136f2abed27 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:22.399076 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5f7da323-209f-44ea-a063-0136f2abed27 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:22.399520 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5f7da323-209f-44ea-a063-0136f2abed27 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:22.521548 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-d991f481-749b-4e2b-96e5-4a9ea3fd075b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:22.522463 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-d991f481-749b-4e2b-96e5-4a9ea3fd075b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:22.529232 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d991f481-749b-4e2b-96e5-4a9ea3fd075b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:22.529683 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d991f481-749b-4e2b-96e5-4a9ea3fd075b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:22.530468 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d991f481-749b-4e2b-96e5-4a9ea3fd075b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:22.530924 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d991f481-749b-4e2b-96e5-4a9ea3fd075b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:22.532579 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-5f7da323-209f-44ea-a063-0136f2abed27 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:22.540270 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-5f7da323-209f-44ea-a063-0136f2abed27 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:22.541776 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-5f7da323-209f-44ea-a063-0136f2abed27 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:22.542960 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-5f7da323-209f-44ea-a063-0136f2abed27 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 200 len: 1725 microversion: 2.20 time: 0.157267 Dec 15 13:40:22.543527 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 582/1160] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:40:22 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:40:22.588969 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-d991f481-749b-4e2b-96e5-4a9ea3fd075b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 28644 microversion: 2.1 time: 0.071038 Dec 15 13:40:22.589589 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 579/1161] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:40:22 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 28644 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:40:22.893201 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-258f70f2-65f8-4aed-92c4-89d01e4733e5 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:22.893820 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-258f70f2-65f8-4aed-92c4-89d01e4733e5 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] [instance: b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:22.900104 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-258f70f2-65f8-4aed-92c4-89d01e4733e5 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:22.900558 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-258f70f2-65f8-4aed-92c4-89d01e4733e5 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:22.901338 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-258f70f2-65f8-4aed-92c4-89d01e4733e5 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:22.901776 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-258f70f2-65f8-4aed-92c4-89d01e4733e5 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:23.036193 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-258f70f2-65f8-4aed-92c4-89d01e4733e5 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7774ea10bce345cabd96a0c94eda98b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ac6d4548e486492887beb2e915bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:23.044535 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-258f70f2-65f8-4aed-92c4-89d01e4733e5 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] 10.222.0.60 "GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e" status: 200 len: 1566 microversion: 2.1 time: 0.154707 Dec 15 13:40:23.045164 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 583/1162] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:22 2021] GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:23.561849 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-f73dda71-4d1f-4110-8292-97804068941f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:23.562575 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-f73dda71-4d1f-4110-8292-97804068941f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:23.569658 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f73dda71-4d1f-4110-8292-97804068941f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:23.570106 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f73dda71-4d1f-4110-8292-97804068941f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:23.570915 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f73dda71-4d1f-4110-8292-97804068941f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:23.571353 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f73dda71-4d1f-4110-8292-97804068941f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:23.600727 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-3ed94b97-a648-4678-80ec-e10b54da6111 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:23.602162 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-3ed94b97-a648-4678-80ec-e10b54da6111 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:23.608501 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3ed94b97-a648-4678-80ec-e10b54da6111 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:23.608952 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3ed94b97-a648-4678-80ec-e10b54da6111 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:23.609750 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3ed94b97-a648-4678-80ec-e10b54da6111 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:23.610194 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3ed94b97-a648-4678-80ec-e10b54da6111 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:23.672761 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-3ed94b97-a648-4678-80ec-e10b54da6111 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 28644 microversion: 2.1 time: 0.075465 Dec 15 13:40:23.676612 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 584/1163] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:40:23 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 28644 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:40:23.704181 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-f73dda71-4d1f-4110-8292-97804068941f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:23.713194 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-f73dda71-4d1f-4110-8292-97804068941f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:23.714686 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-f73dda71-4d1f-4110-8292-97804068941f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:23.715941 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-f73dda71-4d1f-4110-8292-97804068941f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 200 len: 1725 microversion: 2.20 time: 0.158083 Dec 15 13:40:23.716505 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 580/1164] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:40:23 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:40:24.064542 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-2dc72c03-5a19-41bf-ab31-d82dcf7ae341 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:24.065245 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-2dc72c03-5a19-41bf-ab31-d82dcf7ae341 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] [instance: b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:24.072883 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2dc72c03-5a19-41bf-ab31-d82dcf7ae341 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:24.073338 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2dc72c03-5a19-41bf-ab31-d82dcf7ae341 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:24.074126 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2dc72c03-5a19-41bf-ab31-d82dcf7ae341 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:24.074568 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2dc72c03-5a19-41bf-ab31-d82dcf7ae341 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:24.205901 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-2dc72c03-5a19-41bf-ab31-d82dcf7ae341 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7774ea10bce345cabd96a0c94eda98b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ac6d4548e486492887beb2e915bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:24.214300 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-2dc72c03-5a19-41bf-ab31-d82dcf7ae341 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] 10.222.0.60 "GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e" status: 200 len: 1566 microversion: 2.1 time: 0.153751 Dec 15 13:40:24.214890 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 585/1165] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:24 2021] GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:24.684716 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-fb44caea-71e1-49db-b80f-6be41450f37f tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:24.685631 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-fb44caea-71e1-49db-b80f-6be41450f37f tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:24.691967 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-fb44caea-71e1-49db-b80f-6be41450f37f tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:24.692417 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-fb44caea-71e1-49db-b80f-6be41450f37f tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:24.693208 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-fb44caea-71e1-49db-b80f-6be41450f37f tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:24.693647 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-fb44caea-71e1-49db-b80f-6be41450f37f tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:24.734610 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-0038ce6e-c70b-447b-8547-2e1ff0f11ca7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:24.735243 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-0038ce6e-c70b-447b-8547-2e1ff0f11ca7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:24.743572 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0038ce6e-c70b-447b-8547-2e1ff0f11ca7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:24.744374 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0038ce6e-c70b-447b-8547-2e1ff0f11ca7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:24.745628 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0038ce6e-c70b-447b-8547-2e1ff0f11ca7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:24.746070 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0038ce6e-c70b-447b-8547-2e1ff0f11ca7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:24.754378 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-fb44caea-71e1-49db-b80f-6be41450f37f tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 28644 microversion: 2.1 time: 0.073175 Dec 15 13:40:24.755085 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 581/1166] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:40:24 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 28644 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:40:24.875065 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-0038ce6e-c70b-447b-8547-2e1ff0f11ca7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:24.882663 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-0038ce6e-c70b-447b-8547-2e1ff0f11ca7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:24.884181 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-0038ce6e-c70b-447b-8547-2e1ff0f11ca7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:24.885460 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-0038ce6e-c70b-447b-8547-2e1ff0f11ca7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 200 len: 1725 microversion: 2.20 time: 0.154620 Dec 15 13:40:24.885865 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 586/1167] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:40:24 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:40:25.231445 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-3245bf40-4a6d-4664-aefb-8af876996d43 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:25.232156 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-3245bf40-4a6d-4664-aefb-8af876996d43 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] [instance: b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:25.239000 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3245bf40-4a6d-4664-aefb-8af876996d43 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:25.239458 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3245bf40-4a6d-4664-aefb-8af876996d43 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:25.240244 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3245bf40-4a6d-4664-aefb-8af876996d43 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:25.240687 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3245bf40-4a6d-4664-aefb-8af876996d43 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:25.374166 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-3245bf40-4a6d-4664-aefb-8af876996d43 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7774ea10bce345cabd96a0c94eda98b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ac6d4548e486492887beb2e915bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:25.381962 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-3245bf40-4a6d-4664-aefb-8af876996d43 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] 10.222.0.60 "GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e" status: 200 len: 1566 microversion: 2.1 time: 0.154575 Dec 15 13:40:25.383203 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 582/1168] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:25 2021] GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:25.765577 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-a62772dc-e579-4d1e-862c-24ce1d4e8d15 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:25.766516 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-a62772dc-e579-4d1e-862c-24ce1d4e8d15 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:25.773325 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a62772dc-e579-4d1e-862c-24ce1d4e8d15 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:25.773784 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a62772dc-e579-4d1e-862c-24ce1d4e8d15 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:25.774579 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a62772dc-e579-4d1e-862c-24ce1d4e8d15 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:25.775053 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a62772dc-e579-4d1e-862c-24ce1d4e8d15 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:25.838246 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-a62772dc-e579-4d1e-862c-24ce1d4e8d15 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 28644 microversion: 2.1 time: 0.076188 Dec 15 13:40:25.838941 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 587/1169] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:40:25 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 28644 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:40:25.903010 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-cf936f2b-3902-4317-9fb5-93ddbb49c6a3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:25.903627 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-cf936f2b-3902-4317-9fb5-93ddbb49c6a3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:25.909915 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cf936f2b-3902-4317-9fb5-93ddbb49c6a3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:25.910385 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cf936f2b-3902-4317-9fb5-93ddbb49c6a3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:25.911207 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cf936f2b-3902-4317-9fb5-93ddbb49c6a3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:25.911653 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-cf936f2b-3902-4317-9fb5-93ddbb49c6a3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:26.058609 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-cf936f2b-3902-4317-9fb5-93ddbb49c6a3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:26.067166 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-cf936f2b-3902-4317-9fb5-93ddbb49c6a3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:26.068683 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-cf936f2b-3902-4317-9fb5-93ddbb49c6a3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:26.069963 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-cf936f2b-3902-4317-9fb5-93ddbb49c6a3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 200 len: 1725 microversion: 2.20 time: 0.170751 Dec 15 13:40:26.070535 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 583/1170] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:40:25 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:40:26.400525 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-b1ae28f3-3f57-46eb-a3ef-b64898da75a4 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:26.401240 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-b1ae28f3-3f57-46eb-a3ef-b64898da75a4 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] [instance: b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:26.408019 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b1ae28f3-3f57-46eb-a3ef-b64898da75a4 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:26.408473 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b1ae28f3-3f57-46eb-a3ef-b64898da75a4 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:26.409261 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b1ae28f3-3f57-46eb-a3ef-b64898da75a4 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:26.409700 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b1ae28f3-3f57-46eb-a3ef-b64898da75a4 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:26.547141 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-b1ae28f3-3f57-46eb-a3ef-b64898da75a4 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7774ea10bce345cabd96a0c94eda98b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ac6d4548e486492887beb2e915bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:26.554367 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-b1ae28f3-3f57-46eb-a3ef-b64898da75a4 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] 10.222.0.60 "GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e" status: 200 len: 1566 microversion: 2.1 time: 0.158503 Dec 15 13:40:26.555557 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 588/1171] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:26 2021] GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:26.850105 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-bca93a39-378a-46ce-ae83-ebb66aaa2025 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:26.850992 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-bca93a39-378a-46ce-ae83-ebb66aaa2025 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:26.857872 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bca93a39-378a-46ce-ae83-ebb66aaa2025 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:26.858324 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bca93a39-378a-46ce-ae83-ebb66aaa2025 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:26.859148 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bca93a39-378a-46ce-ae83-ebb66aaa2025 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:26.859591 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-bca93a39-378a-46ce-ae83-ebb66aaa2025 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:26.926563 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-bca93a39-378a-46ce-ae83-ebb66aaa2025 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 28644 microversion: 2.1 time: 0.080083 Dec 15 13:40:26.927493 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 584/1172] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:40:26 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 28644 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:40:27.092688 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-28975745-1ea2-4006-b42f-78b91ab48614 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:27.093326 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-28975745-1ea2-4006-b42f-78b91ab48614 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:27.099628 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-28975745-1ea2-4006-b42f-78b91ab48614 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:27.100087 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-28975745-1ea2-4006-b42f-78b91ab48614 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:27.100919 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-28975745-1ea2-4006-b42f-78b91ab48614 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:27.101366 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-28975745-1ea2-4006-b42f-78b91ab48614 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:27.230075 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-28975745-1ea2-4006-b42f-78b91ab48614 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:27.237589 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-28975745-1ea2-4006-b42f-78b91ab48614 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:27.239130 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-28975745-1ea2-4006-b42f-78b91ab48614 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:27.240285 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-28975745-1ea2-4006-b42f-78b91ab48614 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 200 len: 1725 microversion: 2.20 time: 0.151388 Dec 15 13:40:27.240854 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 589/1173] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:40:27 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:40:27.572918 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-f1cdee23-440b-4f44-8b38-3ed5fca35376 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:27.573625 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-f1cdee23-440b-4f44-8b38-3ed5fca35376 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] [instance: b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:27.580737 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f1cdee23-440b-4f44-8b38-3ed5fca35376 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:27.581190 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f1cdee23-440b-4f44-8b38-3ed5fca35376 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:27.581968 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f1cdee23-440b-4f44-8b38-3ed5fca35376 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:27.582403 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f1cdee23-440b-4f44-8b38-3ed5fca35376 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:27.712960 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-f1cdee23-440b-4f44-8b38-3ed5fca35376 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7774ea10bce345cabd96a0c94eda98b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ac6d4548e486492887beb2e915bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:27.720756 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-f1cdee23-440b-4f44-8b38-3ed5fca35376 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] 10.222.0.60 "GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e" status: 200 len: 1566 microversion: 2.1 time: 0.152515 Dec 15 13:40:27.721319 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 585/1174] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:27 2021] GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:27.937606 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-d9a342b3-0c14-4571-b955-1c89ca612575 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:27.938443 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-d9a342b3-0c14-4571-b955-1c89ca612575 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:27.944664 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d9a342b3-0c14-4571-b955-1c89ca612575 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:27.945123 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d9a342b3-0c14-4571-b955-1c89ca612575 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:27.945914 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d9a342b3-0c14-4571-b955-1c89ca612575 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:27.946355 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d9a342b3-0c14-4571-b955-1c89ca612575 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:28.014126 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-d9a342b3-0c14-4571-b955-1c89ca612575 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 28644 microversion: 2.1 time: 0.080159 Dec 15 13:40:28.014758 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 590/1175] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:40:27 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 28644 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:40:28.261034 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-78de331e-8133-415e-911c-658b0fc99223 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:28.261653 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-78de331e-8133-415e-911c-658b0fc99223 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:28.268361 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-78de331e-8133-415e-911c-658b0fc99223 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:28.268811 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-78de331e-8133-415e-911c-658b0fc99223 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:28.269627 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-78de331e-8133-415e-911c-658b0fc99223 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:28.270065 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-78de331e-8133-415e-911c-658b0fc99223 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:28.409198 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-78de331e-8133-415e-911c-658b0fc99223 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:28.417723 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-78de331e-8133-415e-911c-658b0fc99223 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:28.419261 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-78de331e-8133-415e-911c-658b0fc99223 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:28.420491 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-78de331e-8133-415e-911c-658b0fc99223 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 200 len: 1725 microversion: 2.20 time: 0.163105 Dec 15 13:40:28.421069 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 586/1176] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:40:28 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:40:28.737745 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-497cac0c-1cbb-49d3-ad2d-79d9b7329b36 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:28.738455 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-497cac0c-1cbb-49d3-ad2d-79d9b7329b36 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] [instance: b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:28.745328 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-497cac0c-1cbb-49d3-ad2d-79d9b7329b36 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:28.745782 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-497cac0c-1cbb-49d3-ad2d-79d9b7329b36 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:28.746594 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-497cac0c-1cbb-49d3-ad2d-79d9b7329b36 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:28.747138 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-497cac0c-1cbb-49d3-ad2d-79d9b7329b36 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:28.881477 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-497cac0c-1cbb-49d3-ad2d-79d9b7329b36 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7774ea10bce345cabd96a0c94eda98b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ac6d4548e486492887beb2e915bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:28.889480 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-497cac0c-1cbb-49d3-ad2d-79d9b7329b36 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] 10.222.0.60 "GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e" status: 200 len: 1567 microversion: 2.1 time: 0.155731 Dec 15 13:40:28.890053 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 591/1177] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:28 2021] GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:28.905451 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-73ab064b-4071-4a68-a5d8-ddad183e2f02 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:28.906025 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-73ab064b-4071-4a68-a5d8-ddad183e2f02 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] [instance: b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:28.912239 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-73ab064b-4071-4a68-a5d8-ddad183e2f02 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:28.912694 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-73ab064b-4071-4a68-a5d8-ddad183e2f02 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:28.913474 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-73ab064b-4071-4a68-a5d8-ddad183e2f02 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:28.913908 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-73ab064b-4071-4a68-a5d8-ddad183e2f02 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:28.985164 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-73ab064b-4071-4a68-a5d8-ddad183e2f02 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] 10.222.0.60 "POST /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e/action" status: 202 len: 0 microversion: 2.1 time: 0.083406 Dec 15 13:40:28.985981 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 587/1178] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:40:28 2021] POST /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:40:28.993984 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-3d01afc1-6431-49af-943a-c0fdb81e6328 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:28.994602 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-3d01afc1-6431-49af-943a-c0fdb81e6328 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] [instance: b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:29.000325 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3d01afc1-6431-49af-943a-c0fdb81e6328 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:29.000854 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3d01afc1-6431-49af-943a-c0fdb81e6328 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:29.001714 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3d01afc1-6431-49af-943a-c0fdb81e6328 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:29.002238 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3d01afc1-6431-49af-943a-c0fdb81e6328 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:29.025853 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-88666761-aa7f-488b-81c6-c51265caebdf tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:29.026950 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-88666761-aa7f-488b-81c6-c51265caebdf tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:29.032825 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-88666761-aa7f-488b-81c6-c51265caebdf tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:29.033271 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-88666761-aa7f-488b-81c6-c51265caebdf tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:29.034056 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-88666761-aa7f-488b-81c6-c51265caebdf tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:29.034486 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-88666761-aa7f-488b-81c6-c51265caebdf tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:29.101712 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-88666761-aa7f-488b-81c6-c51265caebdf tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 28644 microversion: 2.1 time: 0.079539 Dec 15 13:40:29.102904 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 588/1179] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:40:29 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 28644 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:40:29.172731 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-3d01afc1-6431-49af-943a-c0fdb81e6328 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7774ea10bce345cabd96a0c94eda98b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ac6d4548e486492887beb2e915bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:29.184983 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-3d01afc1-6431-49af-943a-c0fdb81e6328 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] 10.222.0.60 "GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e" status: 200 len: 1575 microversion: 2.1 time: 0.195075 Dec 15 13:40:29.197186 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 592/1180] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:28 2021] GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e => generated 1575 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:29.439035 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-961b98e2-140b-47fd-afe0-61261cca7a95 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:29.439770 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-961b98e2-140b-47fd-afe0-61261cca7a95 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:29.446571 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-961b98e2-140b-47fd-afe0-61261cca7a95 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:29.447062 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-961b98e2-140b-47fd-afe0-61261cca7a95 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:29.447846 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-961b98e2-140b-47fd-afe0-61261cca7a95 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:29.448280 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-961b98e2-140b-47fd-afe0-61261cca7a95 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:29.582269 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-961b98e2-140b-47fd-afe0-61261cca7a95 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:29.590545 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-961b98e2-140b-47fd-afe0-61261cca7a95 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:29.592079 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-961b98e2-140b-47fd-afe0-61261cca7a95 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:29.593246 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-961b98e2-140b-47fd-afe0-61261cca7a95 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 200 len: 1746 microversion: 2.20 time: 0.158315 Dec 15 13:40:29.593817 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 589/1181] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:40:29 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 1746 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:40:30.113454 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-75d4c4db-bce1-4808-b7cf-9f79e6f27b7f tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:30.114271 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-75d4c4db-bce1-4808-b7cf-9f79e6f27b7f tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:30.120775 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-75d4c4db-bce1-4808-b7cf-9f79e6f27b7f tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:30.121231 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-75d4c4db-bce1-4808-b7cf-9f79e6f27b7f tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:30.122018 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-75d4c4db-bce1-4808-b7cf-9f79e6f27b7f tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:30.122461 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-75d4c4db-bce1-4808-b7cf-9f79e6f27b7f tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:30.192039 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-75d4c4db-bce1-4808-b7cf-9f79e6f27b7f tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 28644 microversion: 2.1 time: 0.082289 Dec 15 13:40:30.192666 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 593/1182] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:40:30 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 28644 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:40:30.203668 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-a0306402-13e8-4cb2-9881-dbee80e7d4c6 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:30.204313 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-a0306402-13e8-4cb2-9881-dbee80e7d4c6 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] [instance: b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:30.211517 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a0306402-13e8-4cb2-9881-dbee80e7d4c6 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:30.211974 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a0306402-13e8-4cb2-9881-dbee80e7d4c6 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:30.212756 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a0306402-13e8-4cb2-9881-dbee80e7d4c6 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:30.213189 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a0306402-13e8-4cb2-9881-dbee80e7d4c6 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:30.343150 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-a0306402-13e8-4cb2-9881-dbee80e7d4c6 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7774ea10bce345cabd96a0c94eda98b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ac6d4548e486492887beb2e915bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:30.350596 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-a0306402-13e8-4cb2-9881-dbee80e7d4c6 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] 10.222.0.60 "GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e" status: 200 len: 1573 microversion: 2.1 time: 0.150584 Dec 15 13:40:30.351207 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 590/1183] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:30 2021] GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e => generated 1573 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:30.612425 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-510422b7-974c-4ac9-ab5b-f2ee539506d0 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:30.613168 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-510422b7-974c-4ac9-ab5b-f2ee539506d0 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:30.620555 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-510422b7-974c-4ac9-ab5b-f2ee539506d0 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:30.621244 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-510422b7-974c-4ac9-ab5b-f2ee539506d0 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:30.622205 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-510422b7-974c-4ac9-ab5b-f2ee539506d0 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:30.622806 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-510422b7-974c-4ac9-ab5b-f2ee539506d0 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:30.755072 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-7442aafe-23c4-45bc-97e9-95224531291f req-e8c4c5b8-9c8e-45e8-b624-7b7c02770e3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e", "name": "network-vif-unplugged", "status": "completed", "tag": "271b8ee8-bedb-4be5-a4e3-37b1a376fe7f"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:30.757294 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:40:30.757294 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: warnings.warn(msg) Dec 15 13:40:30.766021 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-7442aafe-23c4-45bc-97e9-95224531291f req-e8c4c5b8-9c8e-45e8-b624-7b7c02770e3e service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:30.766469 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-7442aafe-23c4-45bc-97e9-95224531291f req-e8c4c5b8-9c8e-45e8-b624-7b7c02770e3e service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:30.778150 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-7442aafe-23c4-45bc-97e9-95224531291f req-e8c4c5b8-9c8e-45e8-b624-7b7c02770e3e service nova] Creating event network-vif-unplugged:271b8ee8-bedb-4be5-a4e3-37b1a376fe7f for instance b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e on hv-cinder-81322 Dec 15 13:40:30.778966 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-510422b7-974c-4ac9-ab5b-f2ee539506d0 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:30.785514 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-7442aafe-23c4-45bc-97e9-95224531291f req-e8c4c5b8-9c8e-45e8-b624-7b7c02770e3e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033954 Dec 15 13:40:30.787716 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 591/1184] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:40:30 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:40:30.789874 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-510422b7-974c-4ac9-ab5b-f2ee539506d0 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:30.792681 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-510422b7-974c-4ac9-ab5b-f2ee539506d0 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:30.793964 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-510422b7-974c-4ac9-ab5b-f2ee539506d0 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 200 len: 1746 microversion: 2.20 time: 0.185605 Dec 15 13:40:30.794877 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 594/1185] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:40:30 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 1746 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:40:31.204590 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-10813051-77a1-427d-8018-5c0181302ebb tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:31.205517 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-10813051-77a1-427d-8018-5c0181302ebb tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:31.212262 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-10813051-77a1-427d-8018-5c0181302ebb tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:31.212714 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-10813051-77a1-427d-8018-5c0181302ebb tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:31.213486 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-10813051-77a1-427d-8018-5c0181302ebb tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:31.213920 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-10813051-77a1-427d-8018-5c0181302ebb tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:31.368536 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-f18c9283-c9e9-4001-be4a-c9ced45df8db tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:31.369141 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-f18c9283-c9e9-4001-be4a-c9ced45df8db tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] [instance: b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:31.375404 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f18c9283-c9e9-4001-be4a-c9ced45df8db tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:31.375856 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f18c9283-c9e9-4001-be4a-c9ced45df8db tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:31.376627 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f18c9283-c9e9-4001-be4a-c9ced45df8db tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:31.377061 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f18c9283-c9e9-4001-be4a-c9ced45df8db tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:31.505739 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-f18c9283-c9e9-4001-be4a-c9ced45df8db tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7774ea10bce345cabd96a0c94eda98b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ac6d4548e486492887beb2e915bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:31.513864 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-f18c9283-c9e9-4001-be4a-c9ced45df8db tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] 10.222.0.60 "GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e" status: 200 len: 1573 microversion: 2.1 time: 0.149003 Dec 15 13:40:31.514441 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 595/1186] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:31 2021] GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e => generated 1573 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:40:31.515076 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-10813051-77a1-427d-8018-5c0181302ebb tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 28644 microversion: 2.1 time: 0.314421 Dec 15 13:40:31.515827 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 592/1187] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:40:31 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 28644 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:40:31.812190 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-18667465-1330-4a85-a5fb-8f78636b1509 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:31.812736 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-18667465-1330-4a85-a5fb-8f78636b1509 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:31.818975 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-18667465-1330-4a85-a5fb-8f78636b1509 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:31.819425 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-18667465-1330-4a85-a5fb-8f78636b1509 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:31.820698 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-18667465-1330-4a85-a5fb-8f78636b1509 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:31.821140 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-18667465-1330-4a85-a5fb-8f78636b1509 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:31.950425 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-18667465-1330-4a85-a5fb-8f78636b1509 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:31.958342 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-18667465-1330-4a85-a5fb-8f78636b1509 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:31.959871 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-18667465-1330-4a85-a5fb-8f78636b1509 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:31.961020 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-18667465-1330-4a85-a5fb-8f78636b1509 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 200 len: 1746 microversion: 2.20 time: 0.152632 Dec 15 13:40:31.961577 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 596/1188] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:40:31 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:40:32.527176 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-7678212f-de51-4886-8bb8-a01f2c7ddc2a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:32.528184 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-7678212f-de51-4886-8bb8-a01f2c7ddc2a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:32.531170 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-0abdeda4-1ce8-4d24-94f8-663cb27990e7 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:32.531829 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-0abdeda4-1ce8-4d24-94f8-663cb27990e7 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] [instance: b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:32.535187 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7678212f-de51-4886-8bb8-a01f2c7ddc2a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:32.535644 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7678212f-de51-4886-8bb8-a01f2c7ddc2a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:32.536433 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7678212f-de51-4886-8bb8-a01f2c7ddc2a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:32.536873 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7678212f-de51-4886-8bb8-a01f2c7ddc2a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:32.538004 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0abdeda4-1ce8-4d24-94f8-663cb27990e7 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:32.538458 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0abdeda4-1ce8-4d24-94f8-663cb27990e7 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:32.539890 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0abdeda4-1ce8-4d24-94f8-663cb27990e7 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:32.540397 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0abdeda4-1ce8-4d24-94f8-663cb27990e7 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:32.604867 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-7678212f-de51-4886-8bb8-a01f2c7ddc2a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 28644 microversion: 2.1 time: 0.081656 Dec 15 13:40:32.605841 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 593/1189] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:40:32 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 28644 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:40:32.673392 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-0abdeda4-1ce8-4d24-94f8-663cb27990e7 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7774ea10bce345cabd96a0c94eda98b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ac6d4548e486492887beb2e915bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:32.681330 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-0abdeda4-1ce8-4d24-94f8-663cb27990e7 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] 10.222.0.60 "GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e" status: 200 len: 1573 microversion: 2.1 time: 0.153759 Dec 15 13:40:32.682011 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 597/1190] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:32 2021] GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:40:32.805926 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-3069100d-d095-4f41-8290-e38e5e374503 req-8534cb53-b72b-4e1f-a6d3-9aa155b23b98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6", "name": "network-vif-plugged", "status": "completed", "tag": "836e8497-8739-4936-a7da-9c197bf1d072"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:32.807494 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:40:32.807494 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: warnings.warn(msg) Dec 15 13:40:32.815206 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-3069100d-d095-4f41-8290-e38e5e374503 req-8534cb53-b72b-4e1f-a6d3-9aa155b23b98 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:32.815656 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-3069100d-d095-4f41-8290-e38e5e374503 req-8534cb53-b72b-4e1f-a6d3-9aa155b23b98 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:32.829155 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-3069100d-d095-4f41-8290-e38e5e374503 req-8534cb53-b72b-4e1f-a6d3-9aa155b23b98 service nova] Creating event network-vif-plugged:836e8497-8739-4936-a7da-9c197bf1d072 for instance f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 on hv-cinder-81322 Dec 15 13:40:32.834074 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-3069100d-d095-4f41-8290-e38e5e374503 req-8534cb53-b72b-4e1f-a6d3-9aa155b23b98 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032143 Dec 15 13:40:32.834654 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 594/1191] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:40:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:40:32.979650 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-a1e4509f-bf63-4997-ab63-5c076c8a8d9a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:32.980288 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-a1e4509f-bf63-4997-ab63-5c076c8a8d9a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:32.986244 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a1e4509f-bf63-4997-ab63-5c076c8a8d9a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:32.986696 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a1e4509f-bf63-4997-ab63-5c076c8a8d9a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:32.987491 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a1e4509f-bf63-4997-ab63-5c076c8a8d9a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:32.987925 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a1e4509f-bf63-4997-ab63-5c076c8a8d9a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:33.126761 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-a1e4509f-bf63-4997-ab63-5c076c8a8d9a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:33.134895 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-a1e4509f-bf63-4997-ab63-5c076c8a8d9a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:33.136380 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-a1e4509f-bf63-4997-ab63-5c076c8a8d9a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:33.137526 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-a1e4509f-bf63-4997-ab63-5c076c8a8d9a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 200 len: 1746 microversion: 2.20 time: 0.162198 Dec 15 13:40:33.138092 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 598/1192] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:40:32 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 1746 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:40:33.618335 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-06b11c52-c1a4-4223-bcdd-70d5fe354f40 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:33.619365 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-06b11c52-c1a4-4223-bcdd-70d5fe354f40 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:33.625474 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-06b11c52-c1a4-4223-bcdd-70d5fe354f40 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:33.625932 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-06b11c52-c1a4-4223-bcdd-70d5fe354f40 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:33.626721 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-06b11c52-c1a4-4223-bcdd-70d5fe354f40 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:33.627200 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-06b11c52-c1a4-4223-bcdd-70d5fe354f40 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:33.685504 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-06b11c52-c1a4-4223-bcdd-70d5fe354f40 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 28644 microversion: 2.1 time: 0.071984 Dec 15 13:40:33.687104 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 595/1193] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:40:33 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 28644 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:40:33.697795 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-8b5758c0-b4f6-40a6-9ffd-3b742f155f5f tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:33.698403 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-8b5758c0-b4f6-40a6-9ffd-3b742f155f5f tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] [instance: b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:33.704720 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8b5758c0-b4f6-40a6-9ffd-3b742f155f5f tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:33.705177 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8b5758c0-b4f6-40a6-9ffd-3b742f155f5f tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:33.706208 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8b5758c0-b4f6-40a6-9ffd-3b742f155f5f tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:33.706642 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-8b5758c0-b4f6-40a6-9ffd-3b742f155f5f tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:33.838046 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-8b5758c0-b4f6-40a6-9ffd-3b742f155f5f tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7774ea10bce345cabd96a0c94eda98b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ac6d4548e486492887beb2e915bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:33.845529 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-8b5758c0-b4f6-40a6-9ffd-3b742f155f5f tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] 10.222.0.60 "GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e" status: 200 len: 1573 microversion: 2.1 time: 0.152099 Dec 15 13:40:33.846143 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 599/1194] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:33 2021] GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e => generated 1573 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:34.156073 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-4253fb5e-386e-4054-a86e-2367f288b4e7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:34.156767 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-4253fb5e-386e-4054-a86e-2367f288b4e7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:34.163510 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4253fb5e-386e-4054-a86e-2367f288b4e7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:34.163955 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4253fb5e-386e-4054-a86e-2367f288b4e7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:34.165289 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4253fb5e-386e-4054-a86e-2367f288b4e7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:34.165723 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4253fb5e-386e-4054-a86e-2367f288b4e7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:34.293874 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-4253fb5e-386e-4054-a86e-2367f288b4e7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:34.302027 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-4253fb5e-386e-4054-a86e-2367f288b4e7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:34.303558 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-4253fb5e-386e-4054-a86e-2367f288b4e7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:34.304756 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-4253fb5e-386e-4054-a86e-2367f288b4e7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 200 len: 1746 microversion: 2.20 time: 0.152821 Dec 15 13:40:34.305322 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 596/1195] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:40:34 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:40:34.697707 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-3c27c99b-2094-4d21-9a7c-f6886dfc60af tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:34.698631 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-3c27c99b-2094-4d21-9a7c-f6886dfc60af tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:34.704629 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3c27c99b-2094-4d21-9a7c-f6886dfc60af tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:34.705094 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3c27c99b-2094-4d21-9a7c-f6886dfc60af tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:34.706141 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3c27c99b-2094-4d21-9a7c-f6886dfc60af tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:34.706585 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3c27c99b-2094-4d21-9a7c-f6886dfc60af tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:34.849424 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-3c27c99b-2094-4d21-9a7c-f6886dfc60af tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 28644 microversion: 2.1 time: 0.155789 Dec 15 13:40:34.853353 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 600/1196] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:40:34 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 28644 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:40:34.862521 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-8b65d0a7-9a87-439d-aa33-521f8ef4e80a tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:34.863198 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-8b65d0a7-9a87-439d-aa33-521f8ef4e80a tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] [instance: b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:34.870012 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8b65d0a7-9a87-439d-aa33-521f8ef4e80a tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:34.870469 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8b65d0a7-9a87-439d-aa33-521f8ef4e80a tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:34.871296 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8b65d0a7-9a87-439d-aa33-521f8ef4e80a tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:34.871741 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8b65d0a7-9a87-439d-aa33-521f8ef4e80a tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:35.012229 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-8b65d0a7-9a87-439d-aa33-521f8ef4e80a tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7774ea10bce345cabd96a0c94eda98b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ac6d4548e486492887beb2e915bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:35.022989 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-8b65d0a7-9a87-439d-aa33-521f8ef4e80a tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] 10.222.0.60 "GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e" status: 200 len: 1573 microversion: 2.1 time: 0.162156 Dec 15 13:40:35.023810 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 597/1197] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:34 2021] GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e => generated 1573 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:35.325022 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-9d78aa0f-7f0d-459d-9b14-5bb0a40e715f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:35.325860 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-9d78aa0f-7f0d-459d-9b14-5bb0a40e715f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:35.332908 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9d78aa0f-7f0d-459d-9b14-5bb0a40e715f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:35.333353 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9d78aa0f-7f0d-459d-9b14-5bb0a40e715f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:35.334239 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9d78aa0f-7f0d-459d-9b14-5bb0a40e715f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:35.334683 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9d78aa0f-7f0d-459d-9b14-5bb0a40e715f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:35.477166 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-9d78aa0f-7f0d-459d-9b14-5bb0a40e715f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:35.485312 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-9d78aa0f-7f0d-459d-9b14-5bb0a40e715f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:35.486965 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-9d78aa0f-7f0d-459d-9b14-5bb0a40e715f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:35.488279 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-9d78aa0f-7f0d-459d-9b14-5bb0a40e715f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 200 len: 1741 microversion: 2.20 time: 0.168225 Dec 15 13:40:35.488921 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 601/1198] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:40:35 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 1741 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:40:35.861133 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-e1d65a98-aa6b-4688-b1e6-5100f4dc0722 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:35.861974 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-e1d65a98-aa6b-4688-b1e6-5100f4dc0722 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:35.868868 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e1d65a98-aa6b-4688-b1e6-5100f4dc0722 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:35.869424 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e1d65a98-aa6b-4688-b1e6-5100f4dc0722 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:35.870090 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e1d65a98-aa6b-4688-b1e6-5100f4dc0722 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:35.870531 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e1d65a98-aa6b-4688-b1e6-5100f4dc0722 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:35.933648 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-e1d65a98-aa6b-4688-b1e6-5100f4dc0722 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 28644 microversion: 2.1 time: 0.076091 Dec 15 13:40:35.934414 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 598/1199] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:40:35 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 28644 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:40:36.040984 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-5d815d31-cce8-4b8e-9b24-a4a4109005f4 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:36.042224 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-5d815d31-cce8-4b8e-9b24-a4a4109005f4 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] [instance: b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:36.048733 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5d815d31-cce8-4b8e-9b24-a4a4109005f4 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:36.049183 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5d815d31-cce8-4b8e-9b24-a4a4109005f4 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:36.049967 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5d815d31-cce8-4b8e-9b24-a4a4109005f4 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:36.050406 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5d815d31-cce8-4b8e-9b24-a4a4109005f4 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:36.189066 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-5d815d31-cce8-4b8e-9b24-a4a4109005f4 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7774ea10bce345cabd96a0c94eda98b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ac6d4548e486492887beb2e915bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:36.197107 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-5d815d31-cce8-4b8e-9b24-a4a4109005f4 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] 10.222.0.60 "GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e" status: 200 len: 1573 microversion: 2.1 time: 0.160247 Dec 15 13:40:36.197915 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 602/1200] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:36 2021] GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e => generated 1573 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:36.509356 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-9833e6d5-28b4-4ba8-b7ed-9c857fa67e79 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:36.510225 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-9833e6d5-28b4-4ba8-b7ed-9c857fa67e79 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:36.519118 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9833e6d5-28b4-4ba8-b7ed-9c857fa67e79 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:36.519793 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9833e6d5-28b4-4ba8-b7ed-9c857fa67e79 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:36.520952 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9833e6d5-28b4-4ba8-b7ed-9c857fa67e79 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:36.521441 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9833e6d5-28b4-4ba8-b7ed-9c857fa67e79 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:36.680948 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-9833e6d5-28b4-4ba8-b7ed-9c857fa67e79 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:36.703247 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-9833e6d5-28b4-4ba8-b7ed-9c857fa67e79 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:36.704815 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-9833e6d5-28b4-4ba8-b7ed-9c857fa67e79 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:36.706261 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-9833e6d5-28b4-4ba8-b7ed-9c857fa67e79 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 200 len: 1741 microversion: 2.20 time: 0.201222 Dec 15 13:40:36.707152 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 599/1201] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:40:36 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 1741 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:40:36.947140 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-a0178624-6064-44c9-bf8c-8a9b35d7c29b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:36.947404 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-a0178624-6064-44c9-bf8c-8a9b35d7c29b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:36.954304 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a0178624-6064-44c9-bf8c-8a9b35d7c29b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:36.954919 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a0178624-6064-44c9-bf8c-8a9b35d7c29b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:36.955802 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a0178624-6064-44c9-bf8c-8a9b35d7c29b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:36.957431 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a0178624-6064-44c9-bf8c-8a9b35d7c29b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:37.022553 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-a0178624-6064-44c9-bf8c-8a9b35d7c29b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 28644 microversion: 2.1 time: 0.080560 Dec 15 13:40:37.024728 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 603/1202] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:40:36 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 28644 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:40:37.215118 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-64a3ecd9-186b-45f9-9788-62737866f523 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:37.216522 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-64a3ecd9-186b-45f9-9788-62737866f523 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] [instance: b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:37.223096 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-64a3ecd9-186b-45f9-9788-62737866f523 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:37.223548 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-64a3ecd9-186b-45f9-9788-62737866f523 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:37.224345 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-64a3ecd9-186b-45f9-9788-62737866f523 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:37.224782 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-64a3ecd9-186b-45f9-9788-62737866f523 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:37.370722 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-64a3ecd9-186b-45f9-9788-62737866f523 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7774ea10bce345cabd96a0c94eda98b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ac6d4548e486492887beb2e915bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:37.378410 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-64a3ecd9-186b-45f9-9788-62737866f523 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] 10.222.0.60 "GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e" status: 200 len: 1573 microversion: 2.1 time: 0.166934 Dec 15 13:40:37.379036 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 600/1203] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:37 2021] GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e => generated 1573 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:37.725558 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-952a8406-66ef-4774-9d10-06bcfa51a4e7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:37.727387 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-952a8406-66ef-4774-9d10-06bcfa51a4e7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:37.734593 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-952a8406-66ef-4774-9d10-06bcfa51a4e7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:37.735273 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-952a8406-66ef-4774-9d10-06bcfa51a4e7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:37.736209 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-952a8406-66ef-4774-9d10-06bcfa51a4e7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:37.736504 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-952a8406-66ef-4774-9d10-06bcfa51a4e7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:37.892011 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-952a8406-66ef-4774-9d10-06bcfa51a4e7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:37.904937 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-952a8406-66ef-4774-9d10-06bcfa51a4e7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:37.906442 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-952a8406-66ef-4774-9d10-06bcfa51a4e7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:37.907660 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-952a8406-66ef-4774-9d10-06bcfa51a4e7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 200 len: 1741 microversion: 2.20 time: 0.186393 Dec 15 13:40:37.908280 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 604/1204] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:40:37 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 1741 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:40:38.035082 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-ed94963d-5225-4322-ac6b-9695bb1fe955 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:38.036236 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-ed94963d-5225-4322-ac6b-9695bb1fe955 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:38.043801 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ed94963d-5225-4322-ac6b-9695bb1fe955 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:38.044345 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ed94963d-5225-4322-ac6b-9695bb1fe955 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:38.045286 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ed94963d-5225-4322-ac6b-9695bb1fe955 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:38.045874 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ed94963d-5225-4322-ac6b-9695bb1fe955 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:38.159804 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-ed94963d-5225-4322-ac6b-9695bb1fe955 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 28644 microversion: 2.1 time: 0.128411 Dec 15 13:40:38.160684 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 601/1205] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:40:38 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 28644 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:40:38.396174 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-e40ea639-46b2-466f-8cad-f7ada1a4ea87 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:38.396808 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-e40ea639-46b2-466f-8cad-f7ada1a4ea87 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] [instance: b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:38.404376 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e40ea639-46b2-466f-8cad-f7ada1a4ea87 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:38.404846 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e40ea639-46b2-466f-8cad-f7ada1a4ea87 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:38.405686 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e40ea639-46b2-466f-8cad-f7ada1a4ea87 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:38.406141 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e40ea639-46b2-466f-8cad-f7ada1a4ea87 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:38.574894 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-e40ea639-46b2-466f-8cad-f7ada1a4ea87 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7774ea10bce345cabd96a0c94eda98b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ac6d4548e486492887beb2e915bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:38.583157 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-e40ea639-46b2-466f-8cad-f7ada1a4ea87 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] 10.222.0.60 "GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e" status: 200 len: 1573 microversion: 2.1 time: 0.190777 Dec 15 13:40:38.589060 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 605/1206] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:38 2021] GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e => generated 1573 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:38.925987 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-f9acfb92-051c-46de-b7b4-ec4a8de73d57 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:38.926682 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-f9acfb92-051c-46de-b7b4-ec4a8de73d57 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:38.934387 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f9acfb92-051c-46de-b7b4-ec4a8de73d57 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:38.934860 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f9acfb92-051c-46de-b7b4-ec4a8de73d57 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:38.935815 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f9acfb92-051c-46de-b7b4-ec4a8de73d57 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:38.936257 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f9acfb92-051c-46de-b7b4-ec4a8de73d57 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:39.089273 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-f9acfb92-051c-46de-b7b4-ec4a8de73d57 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:39.102807 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-f9acfb92-051c-46de-b7b4-ec4a8de73d57 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:39.105017 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-f9acfb92-051c-46de-b7b4-ec4a8de73d57 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:39.106470 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-f9acfb92-051c-46de-b7b4-ec4a8de73d57 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 200 len: 1741 microversion: 2.20 time: 0.184695 Dec 15 13:40:39.107744 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 602/1207] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:40:38 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 1741 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:40:39.171767 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ea6ef621-52cb-4df4-a685-5c08c885b1bc tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:39.172851 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ea6ef621-52cb-4df4-a685-5c08c885b1bc tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:39.179028 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ea6ef621-52cb-4df4-a685-5c08c885b1bc tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:39.180533 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ea6ef621-52cb-4df4-a685-5c08c885b1bc tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:39.185700 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ea6ef621-52cb-4df4-a685-5c08c885b1bc tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:39.188265 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ea6ef621-52cb-4df4-a685-5c08c885b1bc tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:39.260755 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ea6ef621-52cb-4df4-a685-5c08c885b1bc tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 28644 microversion: 2.1 time: 0.092793 Dec 15 13:40:39.265256 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 606/1208] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:40:39 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 28644 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:40:39.599904 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-17bdf791-2747-4d27-8f91-6991e9176693 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:39.600919 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-17bdf791-2747-4d27-8f91-6991e9176693 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] [instance: b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:39.608796 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-17bdf791-2747-4d27-8f91-6991e9176693 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:39.609554 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-17bdf791-2747-4d27-8f91-6991e9176693 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:39.610619 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-17bdf791-2747-4d27-8f91-6991e9176693 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:39.611335 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-17bdf791-2747-4d27-8f91-6991e9176693 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:39.772403 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-17bdf791-2747-4d27-8f91-6991e9176693 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7774ea10bce345cabd96a0c94eda98b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ac6d4548e486492887beb2e915bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:39.780708 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-17bdf791-2747-4d27-8f91-6991e9176693 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] 10.222.0.60 "GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e" status: 200 len: 1573 microversion: 2.1 time: 0.184387 Dec 15 13:40:39.781482 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 603/1209] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:39 2021] GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e => generated 1573 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:40.129081 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-9ce07c4e-8f3a-479d-9408-6d180c8af068 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:40.130105 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-9ce07c4e-8f3a-479d-9408-6d180c8af068 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:40.139720 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9ce07c4e-8f3a-479d-9408-6d180c8af068 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:40.140188 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9ce07c4e-8f3a-479d-9408-6d180c8af068 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:40.141002 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9ce07c4e-8f3a-479d-9408-6d180c8af068 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:40.141449 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9ce07c4e-8f3a-479d-9408-6d180c8af068 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:40.274134 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-514ee9d0-cf03-41ee-8dc6-c8b0b3883576 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:40.275630 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-514ee9d0-cf03-41ee-8dc6-c8b0b3883576 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:40.282888 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-514ee9d0-cf03-41ee-8dc6-c8b0b3883576 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:40.283836 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-514ee9d0-cf03-41ee-8dc6-c8b0b3883576 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:40.284730 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-514ee9d0-cf03-41ee-8dc6-c8b0b3883576 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:40.285714 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-514ee9d0-cf03-41ee-8dc6-c8b0b3883576 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:40.291673 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-9ce07c4e-8f3a-479d-9408-6d180c8af068 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:40.299724 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-9ce07c4e-8f3a-479d-9408-6d180c8af068 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:40.301252 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-9ce07c4e-8f3a-479d-9408-6d180c8af068 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:40.302470 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-9ce07c4e-8f3a-479d-9408-6d180c8af068 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 200 len: 1741 microversion: 2.20 time: 0.179793 Dec 15 13:40:40.310643 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 607/1210] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:40:40 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 1741 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:40:40.357834 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-514ee9d0-cf03-41ee-8dc6-c8b0b3883576 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 28644 microversion: 2.1 time: 0.087586 Dec 15 13:40:40.358528 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 604/1211] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:40:40 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 28644 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:40:40.799004 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-97199e07-7a49-48ad-977f-4d22553fc3b9 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:40.800466 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-97199e07-7a49-48ad-977f-4d22553fc3b9 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] [instance: b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:40.808178 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-97199e07-7a49-48ad-977f-4d22553fc3b9 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:40.808981 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-97199e07-7a49-48ad-977f-4d22553fc3b9 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:40.810258 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-97199e07-7a49-48ad-977f-4d22553fc3b9 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:40.811728 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-97199e07-7a49-48ad-977f-4d22553fc3b9 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:41.000817 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-97199e07-7a49-48ad-977f-4d22553fc3b9 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7774ea10bce345cabd96a0c94eda98b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ac6d4548e486492887beb2e915bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:41.008884 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-97199e07-7a49-48ad-977f-4d22553fc3b9 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] 10.222.0.60 "GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e" status: 200 len: 1560 microversion: 2.1 time: 0.214652 Dec 15 13:40:41.009744 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 608/1212] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:40 2021] GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e => generated 1560 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:40:41.322687 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-83fbe066-59b6-40d5-8bbc-a8f808c7a1de tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:41.323620 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-83fbe066-59b6-40d5-8bbc-a8f808c7a1de tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:41.330604 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-83fbe066-59b6-40d5-8bbc-a8f808c7a1de tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:41.331552 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-83fbe066-59b6-40d5-8bbc-a8f808c7a1de tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:41.332419 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-83fbe066-59b6-40d5-8bbc-a8f808c7a1de tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:41.332862 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-83fbe066-59b6-40d5-8bbc-a8f808c7a1de tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:41.369547 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-85c40dfc-127f-4717-a35e-583f1943ee40 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:41.371189 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-85c40dfc-127f-4717-a35e-583f1943ee40 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:41.391767 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-85c40dfc-127f-4717-a35e-583f1943ee40 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:41.392887 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-85c40dfc-127f-4717-a35e-583f1943ee40 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:41.393976 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-85c40dfc-127f-4717-a35e-583f1943ee40 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:41.394494 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-85c40dfc-127f-4717-a35e-583f1943ee40 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:41.484087 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-85c40dfc-127f-4717-a35e-583f1943ee40 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 29672 microversion: 2.1 time: 0.118002 Dec 15 13:40:41.485207 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 609/1213] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:40:41 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 29672 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:40:41.532536 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-83fbe066-59b6-40d5-8bbc-a8f808c7a1de tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:41.544156 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-83fbe066-59b6-40d5-8bbc-a8f808c7a1de tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:41.545650 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-83fbe066-59b6-40d5-8bbc-a8f808c7a1de tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:41.546861 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-83fbe066-59b6-40d5-8bbc-a8f808c7a1de tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 200 len: 1741 microversion: 2.20 time: 0.229294 Dec 15 13:40:41.547721 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 605/1214] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:40:41 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 1741 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:40:42.496840 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-6dc0b1f2-9d38-497a-a44c-17007ca6b02a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:42.498840 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-6dc0b1f2-9d38-497a-a44c-17007ca6b02a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:42.511792 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6dc0b1f2-9d38-497a-a44c-17007ca6b02a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:42.512255 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6dc0b1f2-9d38-497a-a44c-17007ca6b02a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:42.513077 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6dc0b1f2-9d38-497a-a44c-17007ca6b02a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:42.513521 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-6dc0b1f2-9d38-497a-a44c-17007ca6b02a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:42.567363 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-e4a26c61-ce43-4ca6-9715-035d758e6c6a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:42.567975 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-e4a26c61-ce43-4ca6-9715-035d758e6c6a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:42.574676 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e4a26c61-ce43-4ca6-9715-035d758e6c6a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:42.575160 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e4a26c61-ce43-4ca6-9715-035d758e6c6a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:42.576920 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e4a26c61-ce43-4ca6-9715-035d758e6c6a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:42.577432 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e4a26c61-ce43-4ca6-9715-035d758e6c6a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:42.615760 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-6dc0b1f2-9d38-497a-a44c-17007ca6b02a tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 31457 microversion: 2.1 time: 0.122934 Dec 15 13:40:42.616837 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 610/1215] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:40:42 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 31457 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:40:42.756306 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-e4a26c61-ce43-4ca6-9715-035d758e6c6a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:42.766402 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-e4a26c61-ce43-4ca6-9715-035d758e6c6a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:42.768206 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-e4a26c61-ce43-4ca6-9715-035d758e6c6a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:42.769378 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-e4a26c61-ce43-4ca6-9715-035d758e6c6a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 200 len: 1741 microversion: 2.20 time: 0.207938 Dec 15 13:40:42.775185 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 606/1216] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:40:42 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 1741 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:40:42.840808 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-93b88f36-4c56-4e0c-9a37-da178e89e046 req-a5c424b5-4a47-4167-9c48-d918d373648b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e", "name": "network-vif-plugged", "status": "completed", "tag": "271b8ee8-bedb-4be5-a4e3-37b1a376fe7f"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:42.842634 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:40:42.842634 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: warnings.warn(msg) Dec 15 13:40:42.850945 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-93b88f36-4c56-4e0c-9a37-da178e89e046 req-a5c424b5-4a47-4167-9c48-d918d373648b service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:42.851738 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-93b88f36-4c56-4e0c-9a37-da178e89e046 req-a5c424b5-4a47-4167-9c48-d918d373648b service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:42.864282 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-93b88f36-4c56-4e0c-9a37-da178e89e046 req-a5c424b5-4a47-4167-9c48-d918d373648b service nova] Creating event network-vif-plugged:271b8ee8-bedb-4be5-a4e3-37b1a376fe7f for instance b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e on hv-cinder-81322 Dec 15 13:40:42.870584 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-93b88f36-4c56-4e0c-9a37-da178e89e046 req-a5c424b5-4a47-4167-9c48-d918d373648b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034160 Dec 15 13:40:42.871860 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 611/1217] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:40:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:40:43.627583 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-ee8c5f45-427c-4094-bd2c-0542a8c03670 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:43.628503 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-ee8c5f45-427c-4094-bd2c-0542a8c03670 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:43.635188 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ee8c5f45-427c-4094-bd2c-0542a8c03670 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:43.635920 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ee8c5f45-427c-4094-bd2c-0542a8c03670 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:43.636959 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ee8c5f45-427c-4094-bd2c-0542a8c03670 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:43.637621 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ee8c5f45-427c-4094-bd2c-0542a8c03670 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:43.724007 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-ee8c5f45-427c-4094-bd2c-0542a8c03670 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 32976 microversion: 2.1 time: 0.099798 Dec 15 13:40:43.724590 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 607/1218] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:40:43 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 32976 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:40:43.789148 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-c31f716e-7992-46ce-b5bf-e687482b91fa tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:43.790923 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-c31f716e-7992-46ce-b5bf-e687482b91fa tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:43.798953 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c31f716e-7992-46ce-b5bf-e687482b91fa tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:43.799586 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c31f716e-7992-46ce-b5bf-e687482b91fa tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:43.800408 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c31f716e-7992-46ce-b5bf-e687482b91fa tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:43.801090 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c31f716e-7992-46ce-b5bf-e687482b91fa tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:43.949791 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-c31f716e-7992-46ce-b5bf-e687482b91fa tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:43.958322 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-c31f716e-7992-46ce-b5bf-e687482b91fa tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:43.960045 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-c31f716e-7992-46ce-b5bf-e687482b91fa tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:43.961072 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-c31f716e-7992-46ce-b5bf-e687482b91fa tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 200 len: 1741 microversion: 2.20 time: 0.176439 Dec 15 13:40:43.962218 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 612/1219] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:40:43 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 1741 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:40:44.738226 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-9f89d15c-a032-45a7-8ff5-3b2f8a4da147 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:44.740091 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-9f89d15c-a032-45a7-8ff5-3b2f8a4da147 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:44.746753 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9f89d15c-a032-45a7-8ff5-3b2f8a4da147 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:44.747462 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9f89d15c-a032-45a7-8ff5-3b2f8a4da147 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:44.748448 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9f89d15c-a032-45a7-8ff5-3b2f8a4da147 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:44.749060 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9f89d15c-a032-45a7-8ff5-3b2f8a4da147 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:44.828511 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-9f89d15c-a032-45a7-8ff5-3b2f8a4da147 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 33834 microversion: 2.1 time: 0.094420 Dec 15 13:40:44.832836 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 608/1220] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:40:44 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 33834 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:40:44.980594 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-a9696af8-38b5-4a42-91a1-4d1469ae85a3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:44.981350 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-a9696af8-38b5-4a42-91a1-4d1469ae85a3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:44.988641 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a9696af8-38b5-4a42-91a1-4d1469ae85a3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:44.989105 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a9696af8-38b5-4a42-91a1-4d1469ae85a3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:44.989927 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a9696af8-38b5-4a42-91a1-4d1469ae85a3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:44.990448 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a9696af8-38b5-4a42-91a1-4d1469ae85a3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:45.170708 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-a9696af8-38b5-4a42-91a1-4d1469ae85a3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:45.178744 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-a9696af8-38b5-4a42-91a1-4d1469ae85a3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:45.180958 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-a9696af8-38b5-4a42-91a1-4d1469ae85a3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:45.182135 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-a9696af8-38b5-4a42-91a1-4d1469ae85a3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 200 len: 1741 microversion: 2.20 time: 0.205347 Dec 15 13:40:45.182707 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 613/1221] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:40:44 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 1741 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:40:45.841500 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-af406a03-6df0-4739-ad74-424c63c41286 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:45.842509 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-af406a03-6df0-4739-ad74-424c63c41286 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:45.850175 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-af406a03-6df0-4739-ad74-424c63c41286 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:45.850628 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-af406a03-6df0-4739-ad74-424c63c41286 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:45.851449 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-af406a03-6df0-4739-ad74-424c63c41286 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:45.851921 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-af406a03-6df0-4739-ad74-424c63c41286 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:45.929038 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-af406a03-6df0-4739-ad74-424c63c41286 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 34979 microversion: 2.1 time: 0.091879 Dec 15 13:40:45.929576 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 609/1222] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:40:45 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 34979 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:40:46.200770 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-f16a64ef-4cac-4c98-946e-3611f5fb512b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:46.201378 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-f16a64ef-4cac-4c98-946e-3611f5fb512b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:46.207901 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f16a64ef-4cac-4c98-946e-3611f5fb512b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:46.208298 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f16a64ef-4cac-4c98-946e-3611f5fb512b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:46.209078 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f16a64ef-4cac-4c98-946e-3611f5fb512b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:46.209517 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f16a64ef-4cac-4c98-946e-3611f5fb512b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:46.335579 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-f16a64ef-4cac-4c98-946e-3611f5fb512b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:46.343246 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-f16a64ef-4cac-4c98-946e-3611f5fb512b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:46.344768 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-f16a64ef-4cac-4c98-946e-3611f5fb512b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:46.345921 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-f16a64ef-4cac-4c98-946e-3611f5fb512b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 200 len: 1741 microversion: 2.20 time: 0.148907 Dec 15 13:40:46.346486 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 614/1223] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:40:46 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 1741 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:40:46.941555 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-e7d6dfdb-861f-4cc6-93ea-a84a50dd6209 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:46.942595 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-e7d6dfdb-861f-4cc6-93ea-a84a50dd6209 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:46.949519 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e7d6dfdb-861f-4cc6-93ea-a84a50dd6209 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:46.949979 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e7d6dfdb-861f-4cc6-93ea-a84a50dd6209 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:46.950767 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e7d6dfdb-861f-4cc6-93ea-a84a50dd6209 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:46.951252 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e7d6dfdb-861f-4cc6-93ea-a84a50dd6209 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:47.103252 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-e7d6dfdb-861f-4cc6-93ea-a84a50dd6209 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 35843 microversion: 2.1 time: 0.165038 Dec 15 13:40:47.103918 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 610/1224] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:40:46 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 35843 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:40:47.363603 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-94cfcb56-7585-4628-ad66-a063e9d6c76e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:47.364214 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-94cfcb56-7585-4628-ad66-a063e9d6c76e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:47.370427 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-94cfcb56-7585-4628-ad66-a063e9d6c76e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:47.370976 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-94cfcb56-7585-4628-ad66-a063e9d6c76e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:47.371766 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-94cfcb56-7585-4628-ad66-a063e9d6c76e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:47.372211 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-94cfcb56-7585-4628-ad66-a063e9d6c76e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:47.498233 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-94cfcb56-7585-4628-ad66-a063e9d6c76e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:47.505915 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-94cfcb56-7585-4628-ad66-a063e9d6c76e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:47.507444 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-94cfcb56-7585-4628-ad66-a063e9d6c76e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:47.509089 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-94cfcb56-7585-4628-ad66-a063e9d6c76e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 200 len: 1723 microversion: 2.20 time: 0.148734 Dec 15 13:40:47.509657 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 615/1225] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:40:47 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:40:48.116122 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-79241dd4-eda1-4b29-a3b4-d8ee336e5c6b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:48.117161 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-79241dd4-eda1-4b29-a3b4-d8ee336e5c6b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:48.124747 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-79241dd4-eda1-4b29-a3b4-d8ee336e5c6b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:48.125196 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-79241dd4-eda1-4b29-a3b4-d8ee336e5c6b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:48.125978 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-79241dd4-eda1-4b29-a3b4-d8ee336e5c6b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:48.126415 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-79241dd4-eda1-4b29-a3b4-d8ee336e5c6b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:48.208420 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-79241dd4-eda1-4b29-a3b4-d8ee336e5c6b tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 37133 microversion: 2.1 time: 0.096219 Dec 15 13:40:48.209396 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 611/1226] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:40:48 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 37133 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:40:48.527129 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-2216ab46-5234-4a30-bc77-fb7d4384c5c3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:48.527737 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-2216ab46-5234-4a30-bc77-fb7d4384c5c3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:48.535135 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2216ab46-5234-4a30-bc77-fb7d4384c5c3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:48.535593 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2216ab46-5234-4a30-bc77-fb7d4384c5c3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:48.536376 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2216ab46-5234-4a30-bc77-fb7d4384c5c3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:48.536806 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2216ab46-5234-4a30-bc77-fb7d4384c5c3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:48.668174 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-2216ab46-5234-4a30-bc77-fb7d4384c5c3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:48.676082 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-2216ab46-5234-4a30-bc77-fb7d4384c5c3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:48.677563 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-2216ab46-5234-4a30-bc77-fb7d4384c5c3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:48.678710 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-2216ab46-5234-4a30-bc77-fb7d4384c5c3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 200 len: 1723 microversion: 2.20 time: 0.155885 Dec 15 13:40:48.679311 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 616/1227] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:40:48 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:40:48.747078 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-ada3ded4-ca33-4e0d-a185-07010551c38d req-a8d663a7-9854-41fc-9949-32d64ecee79b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6", "name": "network-vif-unplugged", "status": "completed", "tag": "836e8497-8739-4936-a7da-9c197bf1d072"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:48.748719 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:40:48.748719 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: warnings.warn(msg) Dec 15 13:40:48.757558 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-ada3ded4-ca33-4e0d-a185-07010551c38d req-a8d663a7-9854-41fc-9949-32d64ecee79b service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:48.758013 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-ada3ded4-ca33-4e0d-a185-07010551c38d req-a8d663a7-9854-41fc-9949-32d64ecee79b service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:48.769533 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-ada3ded4-ca33-4e0d-a185-07010551c38d req-a8d663a7-9854-41fc-9949-32d64ecee79b service nova] Creating event network-vif-unplugged:836e8497-8739-4936-a7da-9c197bf1d072 for instance f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 on hv-cinder-81322 Dec 15 13:40:48.775444 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-ada3ded4-ca33-4e0d-a185-07010551c38d req-a8d663a7-9854-41fc-9949-32d64ecee79b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032346 Dec 15 13:40:48.776036 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 612/1228] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:40:48 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:40:49.219736 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-65a3b75c-0ae7-4c8e-b1e8-51fbaec68e53 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:49.220707 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-65a3b75c-0ae7-4c8e-b1e8-51fbaec68e53 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:49.226488 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-65a3b75c-0ae7-4c8e-b1e8-51fbaec68e53 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:49.227935 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-65a3b75c-0ae7-4c8e-b1e8-51fbaec68e53 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:49.228757 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-65a3b75c-0ae7-4c8e-b1e8-51fbaec68e53 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:49.229210 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-65a3b75c-0ae7-4c8e-b1e8-51fbaec68e53 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:49.308259 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-65a3b75c-0ae7-4c8e-b1e8-51fbaec68e53 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 38175 microversion: 2.1 time: 0.092090 Dec 15 13:40:49.310768 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 617/1229] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:40:49 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 38175 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:40:49.696775 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-b1f0897a-4afc-4abe-95ec-61512787a705 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:49.697515 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-b1f0897a-4afc-4abe-95ec-61512787a705 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:49.703671 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b1f0897a-4afc-4abe-95ec-61512787a705 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:49.704125 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b1f0897a-4afc-4abe-95ec-61512787a705 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:49.704911 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b1f0897a-4afc-4abe-95ec-61512787a705 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:49.705355 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b1f0897a-4afc-4abe-95ec-61512787a705 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:49.831090 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-b1f0897a-4afc-4abe-95ec-61512787a705 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:49.839025 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-b1f0897a-4afc-4abe-95ec-61512787a705 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:49.840519 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-b1f0897a-4afc-4abe-95ec-61512787a705 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:49.841674 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-b1f0897a-4afc-4abe-95ec-61512787a705 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 200 len: 1666 microversion: 2.20 time: 0.149425 Dec 15 13:40:49.842241 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 613/1230] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:40:49 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 1666 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:40:49.860113 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ddaeddff-abf5-4bd0-a0ce-21954086b0f3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bdfe0b38-addc-4b0d-a09b-e466a8ac4915"}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:49.861291 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ddaeddff-abf5-4bd0-a0ce-21954086b0f3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:49.868216 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ddaeddff-abf5-4bd0-a0ce-21954086b0f3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:49.869321 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ddaeddff-abf5-4bd0-a0ce-21954086b0f3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:49.870107 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ddaeddff-abf5-4bd0-a0ce-21954086b0f3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:49.870551 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ddaeddff-abf5-4bd0-a0ce-21954086b0f3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:50.125096 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ddaeddff-abf5-4bd0-a0ce-21954086b0f3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.269086 Dec 15 13:40:50.125754 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 618/1231] 10.222.0.60 () {62 vars in 1363 bytes} [Wed Dec 15 13:40:49 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/os-volume_attachments => generated 188 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:40:50.234101 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-8bde2581-a3cb-4a1f-b6f2-117a06af2514 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:50.234683 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-8bde2581-a3cb-4a1f-b6f2-117a06af2514 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:50.241421 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8bde2581-a3cb-4a1f-b6f2-117a06af2514 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:50.241866 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8bde2581-a3cb-4a1f-b6f2-117a06af2514 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:50.242672 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8bde2581-a3cb-4a1f-b6f2-117a06af2514 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:50.243137 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8bde2581-a3cb-4a1f-b6f2-117a06af2514 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:50.319772 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-bdadfbfa-c092-46ab-8b45-7c545cb44eb4 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:50.320910 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-bdadfbfa-c092-46ab-8b45-7c545cb44eb4 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:50.327676 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-bdadfbfa-c092-46ab-8b45-7c545cb44eb4 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:50.328128 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-bdadfbfa-c092-46ab-8b45-7c545cb44eb4 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:50.328909 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-bdadfbfa-c092-46ab-8b45-7c545cb44eb4 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:50.329349 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-bdadfbfa-c092-46ab-8b45-7c545cb44eb4 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:50.389251 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-bdadfbfa-c092-46ab-8b45-7c545cb44eb4 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 38175 microversion: 2.1 time: 0.072911 Dec 15 13:40:50.389905 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 619/1232] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:40:50 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 38175 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:40:50.471707 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-8bde2581-a3cb-4a1f-b6f2-117a06af2514 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/os-volume_attachments/bdfe0b38-addc-4b0d-a09b-e466a8ac4915" status: 202 len: 0 microversion: 2.20 time: 0.241452 Dec 15 13:40:50.472453 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 614/1233] 10.222.0.60 () {60 vars in 1456 bytes} [Wed Dec 15 13:40:50 2021] DELETE /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/os-volume_attachments/bdfe0b38-addc-4b0d-a09b-e466a8ac4915 => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:40:50.526583 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-cc123b39-74a9-415d-8fe5-bde2218ae5b4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:50.527272 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-cc123b39-74a9-415d-8fe5-bde2218ae5b4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:50.533985 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-cc123b39-74a9-415d-8fe5-bde2218ae5b4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:50.534441 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-cc123b39-74a9-415d-8fe5-bde2218ae5b4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:50.535248 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-cc123b39-74a9-415d-8fe5-bde2218ae5b4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:50.535681 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-cc123b39-74a9-415d-8fe5-bde2218ae5b4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:50.623914 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: ERROR oslo.messaging._drivers.impl_rabbit [None req-cc123b39-74a9-415d-8fe5-bde2218ae5b4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [efcd60fb-9cb9-405d-ba97-c460f7bd320b] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 15 13:40:51.401333 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-4b2f4c66-f231-4ab3-aa75-b7d714ad010c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:51.402370 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-4b2f4c66-f231-4ab3-aa75-b7d714ad010c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:51.411687 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4b2f4c66-f231-4ab3-aa75-b7d714ad010c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:51.412142 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4b2f4c66-f231-4ab3-aa75-b7d714ad010c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:51.412929 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4b2f4c66-f231-4ab3-aa75-b7d714ad010c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:51.413370 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-4b2f4c66-f231-4ab3-aa75-b7d714ad010c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:51.471555 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-4b2f4c66-f231-4ab3-aa75-b7d714ad010c tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 38175 microversion: 2.1 time: 0.073835 Dec 15 13:40:51.472224 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 615/1234] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:40:51 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 38175 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:40:51.639985 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO oslo.messaging._drivers.impl_rabbit [None req-cc123b39-74a9-415d-8fe5-bde2218ae5b4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [efcd60fb-9cb9-405d-ba97-c460f7bd320b] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 48466. Dec 15 13:40:51.643198 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-cc123b39-74a9-415d-8fe5-bde2218ae5b4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action" status: 202 len: 0 microversion: 2.20 time: 1.121273 Dec 15 13:40:51.643826 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 620/1235] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 13:40:50 2021] POST /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/action => generated 0 bytes in 1123 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:40:51.652238 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-b9d87ffc-03d2-4736-90b9-d6423d41fbc6 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:51.652875 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-b9d87ffc-03d2-4736-90b9-d6423d41fbc6 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:51.660124 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b9d87ffc-03d2-4736-90b9-d6423d41fbc6 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:51.660584 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b9d87ffc-03d2-4736-90b9-d6423d41fbc6 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:51.661392 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b9d87ffc-03d2-4736-90b9-d6423d41fbc6 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:51.661832 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b9d87ffc-03d2-4736-90b9-d6423d41fbc6 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:51.803271 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-b9d87ffc-03d2-4736-90b9-d6423d41fbc6 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:51.811582 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-b9d87ffc-03d2-4736-90b9-d6423d41fbc6 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:51.813063 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-b9d87ffc-03d2-4736-90b9-d6423d41fbc6 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:51.814213 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-b9d87ffc-03d2-4736-90b9-d6423d41fbc6 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 200 len: 1674 microversion: 2.20 time: 0.166108 Dec 15 13:40:51.814774 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 616/1236] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:40:51 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 1674 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:40:52.485110 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-0bc452bb-ca06-4a71-97e0-3a39347dcfee tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:52.486014 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-0bc452bb-ca06-4a71-97e0-3a39347dcfee tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:52.493413 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0bc452bb-ca06-4a71-97e0-3a39347dcfee tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:52.494154 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0bc452bb-ca06-4a71-97e0-3a39347dcfee tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:52.494990 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0bc452bb-ca06-4a71-97e0-3a39347dcfee tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:52.495431 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-0bc452bb-ca06-4a71-97e0-3a39347dcfee tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:52.577485 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-0bc452bb-ca06-4a71-97e0-3a39347dcfee tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action" status: 200 len: 38304 microversion: 2.1 time: 0.096253 Dec 15 13:40:52.578428 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 621/1237] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 13:40:52 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/action => generated 38304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:40:52.590360 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-253895c5-6704-4465-b8b1-430d622c9c83 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:52.590928 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-253895c5-6704-4465-b8b1-430d622c9c83 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:52.598417 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-253895c5-6704-4465-b8b1-430d622c9c83 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:52.598970 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-253895c5-6704-4465-b8b1-430d622c9c83 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:52.600217 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-253895c5-6704-4465-b8b1-430d622c9c83 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:52.600658 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-253895c5-6704-4465-b8b1-430d622c9c83 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:52.624358 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-253895c5-6704-4465-b8b1-430d622c9c83 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/ips" status: 200 len: 145 microversion: 2.1 time: 0.039022 Dec 15 13:40:52.624970 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 617/1238] 10.222.0.60 () {58 vars in 1247 bytes} [Wed Dec 15 13:40:52 2021] GET /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/ips => generated 145 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:40:52.832310 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-c5b200df-acd3-494b-9fc1-7f03d1144613 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:52.833016 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-c5b200df-acd3-494b-9fc1-7f03d1144613 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:52.840494 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c5b200df-acd3-494b-9fc1-7f03d1144613 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:52.840956 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c5b200df-acd3-494b-9fc1-7f03d1144613 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:52.841748 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c5b200df-acd3-494b-9fc1-7f03d1144613 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:52.842188 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c5b200df-acd3-494b-9fc1-7f03d1144613 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:52.985237 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-c5b200df-acd3-494b-9fc1-7f03d1144613 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:52.992863 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-c5b200df-acd3-494b-9fc1-7f03d1144613 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:52.994973 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-c5b200df-acd3-494b-9fc1-7f03d1144613 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:52.996072 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-c5b200df-acd3-494b-9fc1-7f03d1144613 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 200 len: 1732 microversion: 2.20 time: 0.168187 Dec 15 13:40:52.996635 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 622/1239] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:40:52 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:40:53.933065 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-88fecf5b-b706-4fd0-96bd-d01f28f3c3bf tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f69ebf18-0983-4788-976f-411a9aec7f7b"}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:53.934134 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-88fecf5b-b706-4fd0-96bd-d01f28f3c3bf tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:53.940566 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-88fecf5b-b706-4fd0-96bd-d01f28f3c3bf tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:53.941016 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-88fecf5b-b706-4fd0-96bd-d01f28f3c3bf tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:53.941807 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-88fecf5b-b706-4fd0-96bd-d01f28f3c3bf tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:53.942244 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-88fecf5b-b706-4fd0-96bd-d01f28f3c3bf tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:54.017266 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-becc247f-bf01-45f4-afe1-c6e084bdd7f9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:54.018708 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-becc247f-bf01-45f4-afe1-c6e084bdd7f9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:54.026912 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-becc247f-bf01-45f4-afe1-c6e084bdd7f9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:54.027699 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-becc247f-bf01-45f4-afe1-c6e084bdd7f9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:54.028520 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-becc247f-bf01-45f4-afe1-c6e084bdd7f9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:54.029027 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-becc247f-bf01-45f4-afe1-c6e084bdd7f9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:54.168069 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-becc247f-bf01-45f4-afe1-c6e084bdd7f9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:54.176008 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-becc247f-bf01-45f4-afe1-c6e084bdd7f9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:54.177664 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-becc247f-bf01-45f4-afe1-c6e084bdd7f9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:54.178869 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-becc247f-bf01-45f4-afe1-c6e084bdd7f9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 200 len: 1732 microversion: 2.20 time: 0.166811 Dec 15 13:40:54.179508 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 623/1240] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:40:54 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:40:55.198381 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-b53e8671-f578-4144-a029-ada1742899fc tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:55.200357 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-b53e8671-f578-4144-a029-ada1742899fc tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:55.206142 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b53e8671-f578-4144-a029-ada1742899fc tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:55.206602 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b53e8671-f578-4144-a029-ada1742899fc tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:55.207714 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b53e8671-f578-4144-a029-ada1742899fc tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:55.208166 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-b53e8671-f578-4144-a029-ada1742899fc tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:55.343305 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-b53e8671-f578-4144-a029-ada1742899fc tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:55.351210 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-b53e8671-f578-4144-a029-ada1742899fc tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:55.352713 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-b53e8671-f578-4144-a029-ada1742899fc tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:55.353903 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-b53e8671-f578-4144-a029-ada1742899fc tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 200 len: 1732 microversion: 2.20 time: 0.160048 Dec 15 13:40:55.354484 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 624/1241] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:40:55 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:40:56.371806 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-16149c7e-a94d-49c8-8d1f-1e4f855f8366 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:56.372511 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-16149c7e-a94d-49c8-8d1f-1e4f855f8366 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:56.378992 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-16149c7e-a94d-49c8-8d1f-1e4f855f8366 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:56.379520 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-16149c7e-a94d-49c8-8d1f-1e4f855f8366 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:56.380380 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-16149c7e-a94d-49c8-8d1f-1e4f855f8366 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:56.380896 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-16149c7e-a94d-49c8-8d1f-1e4f855f8366 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:56.518473 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-16149c7e-a94d-49c8-8d1f-1e4f855f8366 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:56.527011 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-16149c7e-a94d-49c8-8d1f-1e4f855f8366 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:56.528539 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-16149c7e-a94d-49c8-8d1f-1e4f855f8366 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:56.529715 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-16149c7e-a94d-49c8-8d1f-1e4f855f8366 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 200 len: 1732 microversion: 2.20 time: 0.161762 Dec 15 13:40:56.530279 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 625/1242] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:40:56 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:40:57.547808 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-2c917fd0-803f-4d05-8405-382b4aca3759 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:57.548639 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-2c917fd0-803f-4d05-8405-382b4aca3759 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:57.554900 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2c917fd0-803f-4d05-8405-382b4aca3759 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:57.555350 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2c917fd0-803f-4d05-8405-382b4aca3759 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:57.556157 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2c917fd0-803f-4d05-8405-382b4aca3759 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:57.556593 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-2c917fd0-803f-4d05-8405-382b4aca3759 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:57.694317 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-2c917fd0-803f-4d05-8405-382b4aca3759 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:57.702347 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-2c917fd0-803f-4d05-8405-382b4aca3759 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:57.703952 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-2c917fd0-803f-4d05-8405-382b4aca3759 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:57.705209 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-2c917fd0-803f-4d05-8405-382b4aca3759 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 200 len: 1732 microversion: 2.20 time: 0.161190 Dec 15 13:40:57.705850 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 626/1243] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:40:57 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:40:58.723911 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-5ca8a7b7-b5f7-419e-88de-b83d885646e7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:58.724585 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-5ca8a7b7-b5f7-419e-88de-b83d885646e7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:58.731922 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5ca8a7b7-b5f7-419e-88de-b83d885646e7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:58.732380 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5ca8a7b7-b5f7-419e-88de-b83d885646e7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:58.733182 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5ca8a7b7-b5f7-419e-88de-b83d885646e7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:58.733622 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5ca8a7b7-b5f7-419e-88de-b83d885646e7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:58.918571 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-5ca8a7b7-b5f7-419e-88de-b83d885646e7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:58.926500 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-5ca8a7b7-b5f7-419e-88de-b83d885646e7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:58.928036 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-5ca8a7b7-b5f7-419e-88de-b83d885646e7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:58.929210 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-5ca8a7b7-b5f7-419e-88de-b83d885646e7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 200 len: 1732 microversion: 2.20 time: 0.209036 Dec 15 13:40:58.929965 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 627/1244] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:40:58 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 1732 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:40:59.947891 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-9c37b5ae-6f57-4318-85c5-96fffa9b0e35 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:59.948672 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-9c37b5ae-6f57-4318-85c5-96fffa9b0e35 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:59.955126 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9c37b5ae-6f57-4318-85c5-96fffa9b0e35 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:59.955576 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9c37b5ae-6f57-4318-85c5-96fffa9b0e35 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:59.956661 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9c37b5ae-6f57-4318-85c5-96fffa9b0e35 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:59.957102 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9c37b5ae-6f57-4318-85c5-96fffa9b0e35 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:00.091993 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-9c37b5ae-6f57-4318-85c5-96fffa9b0e35 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:00.100483 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-9c37b5ae-6f57-4318-85c5-96fffa9b0e35 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:00.102070 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-9c37b5ae-6f57-4318-85c5-96fffa9b0e35 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:00.103996 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-9c37b5ae-6f57-4318-85c5-96fffa9b0e35 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 200 len: 1732 microversion: 2.20 time: 0.160530 Dec 15 13:41:00.104759 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 628/1245] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:40:59 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:41:01.125986 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-dbf69eae-2fd6-4a3a-8062-d380a6f3a379 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:01.126674 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-dbf69eae-2fd6-4a3a-8062-d380a6f3a379 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:01.133147 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-dbf69eae-2fd6-4a3a-8062-d380a6f3a379 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:01.133579 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-dbf69eae-2fd6-4a3a-8062-d380a6f3a379 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:01.134485 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-dbf69eae-2fd6-4a3a-8062-d380a6f3a379 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:01.134960 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-dbf69eae-2fd6-4a3a-8062-d380a6f3a379 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:01.268265 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-dbf69eae-2fd6-4a3a-8062-d380a6f3a379 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:01.277455 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-dbf69eae-2fd6-4a3a-8062-d380a6f3a379 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:01.279003 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-dbf69eae-2fd6-4a3a-8062-d380a6f3a379 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:01.280177 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-dbf69eae-2fd6-4a3a-8062-d380a6f3a379 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 200 len: 1732 microversion: 2.20 time: 0.158084 Dec 15 13:41:01.280749 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 629/1246] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:41:01 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:41:02.299348 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-5e522f00-065b-487f-be29-d84a600938bd tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:02.300038 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-5e522f00-065b-487f-be29-d84a600938bd tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:02.307260 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5e522f00-065b-487f-be29-d84a600938bd tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:02.307719 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5e522f00-065b-487f-be29-d84a600938bd tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:02.308509 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5e522f00-065b-487f-be29-d84a600938bd tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:02.308942 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5e522f00-065b-487f-be29-d84a600938bd tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:02.445881 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-5e522f00-065b-487f-be29-d84a600938bd tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:02.454127 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-5e522f00-065b-487f-be29-d84a600938bd tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:02.455658 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-5e522f00-065b-487f-be29-d84a600938bd tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:02.456820 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-5e522f00-065b-487f-be29-d84a600938bd tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 200 len: 1732 microversion: 2.20 time: 0.161614 Dec 15 13:41:02.457398 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 630/1247] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:41:02 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:41:03.475443 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-e4417eb5-d235-4d94-90bb-1c89986afda2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:03.476183 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-e4417eb5-d235-4d94-90bb-1c89986afda2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:03.482398 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e4417eb5-d235-4d94-90bb-1c89986afda2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:03.482880 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e4417eb5-d235-4d94-90bb-1c89986afda2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:03.483689 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e4417eb5-d235-4d94-90bb-1c89986afda2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:03.484134 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e4417eb5-d235-4d94-90bb-1c89986afda2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:03.619556 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-e4417eb5-d235-4d94-90bb-1c89986afda2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:03.627638 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-e4417eb5-d235-4d94-90bb-1c89986afda2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:03.629136 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-e4417eb5-d235-4d94-90bb-1c89986afda2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:03.630318 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-e4417eb5-d235-4d94-90bb-1c89986afda2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 200 len: 1732 microversion: 2.20 time: 0.158605 Dec 15 13:41:03.631131 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 631/1248] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:41:03 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:41:04.649072 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-d70195f9-a4c3-4103-a51e-eb79d0ac465f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:04.649778 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-d70195f9-a4c3-4103-a51e-eb79d0ac465f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:04.656805 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d70195f9-a4c3-4103-a51e-eb79d0ac465f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:04.657260 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d70195f9-a4c3-4103-a51e-eb79d0ac465f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:04.658061 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d70195f9-a4c3-4103-a51e-eb79d0ac465f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:04.658506 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d70195f9-a4c3-4103-a51e-eb79d0ac465f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:04.808797 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-d70195f9-a4c3-4103-a51e-eb79d0ac465f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:04.817318 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-d70195f9-a4c3-4103-a51e-eb79d0ac465f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:04.818815 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-d70195f9-a4c3-4103-a51e-eb79d0ac465f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:04.820017 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-d70195f9-a4c3-4103-a51e-eb79d0ac465f tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 200 len: 1732 microversion: 2.20 time: 0.174690 Dec 15 13:41:04.820683 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 632/1249] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:41:04 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 1732 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:41:05.838410 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-82ee67d9-8587-4856-8a6f-c0e3522d481a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:05.839109 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-82ee67d9-8587-4856-8a6f-c0e3522d481a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:05.845323 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-82ee67d9-8587-4856-8a6f-c0e3522d481a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:05.845778 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-82ee67d9-8587-4856-8a6f-c0e3522d481a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:05.846570 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-82ee67d9-8587-4856-8a6f-c0e3522d481a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:05.847040 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-82ee67d9-8587-4856-8a6f-c0e3522d481a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:05.974980 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-82ee67d9-8587-4856-8a6f-c0e3522d481a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:05.983316 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-82ee67d9-8587-4856-8a6f-c0e3522d481a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:05.984824 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-82ee67d9-8587-4856-8a6f-c0e3522d481a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:05.985985 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-82ee67d9-8587-4856-8a6f-c0e3522d481a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 200 len: 1732 microversion: 2.20 time: 0.151655 Dec 15 13:41:05.986545 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 633/1250] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:41:05 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:41:07.133382 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-09ba1fc0-8a6c-472e-8060-1bd5275ef1c4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:07.133989 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-09ba1fc0-8a6c-472e-8060-1bd5275ef1c4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:07.140405 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-09ba1fc0-8a6c-472e-8060-1bd5275ef1c4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:07.140871 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-09ba1fc0-8a6c-472e-8060-1bd5275ef1c4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:07.141628 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-09ba1fc0-8a6c-472e-8060-1bd5275ef1c4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:07.142063 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-09ba1fc0-8a6c-472e-8060-1bd5275ef1c4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:07.267627 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-09ba1fc0-8a6c-472e-8060-1bd5275ef1c4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:07.275241 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-09ba1fc0-8a6c-472e-8060-1bd5275ef1c4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:07.277376 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-09ba1fc0-8a6c-472e-8060-1bd5275ef1c4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:07.278531 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-09ba1fc0-8a6c-472e-8060-1bd5275ef1c4 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 200 len: 1732 microversion: 2.20 time: 0.277700 Dec 15 13:41:07.279313 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 634/1251] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:41:06 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 1732 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:41:08.297097 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-a6a3eb34-6d03-43f0-8042-ef8c4fe66ae6 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:08.297745 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-a6a3eb34-6d03-43f0-8042-ef8c4fe66ae6 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:08.303944 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a6a3eb34-6d03-43f0-8042-ef8c4fe66ae6 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:08.304396 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a6a3eb34-6d03-43f0-8042-ef8c4fe66ae6 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:08.305179 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a6a3eb34-6d03-43f0-8042-ef8c4fe66ae6 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:08.305621 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a6a3eb34-6d03-43f0-8042-ef8c4fe66ae6 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:08.437352 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-a6a3eb34-6d03-43f0-8042-ef8c4fe66ae6 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:08.445632 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-a6a3eb34-6d03-43f0-8042-ef8c4fe66ae6 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:08.447270 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-a6a3eb34-6d03-43f0-8042-ef8c4fe66ae6 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:08.449234 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-a6a3eb34-6d03-43f0-8042-ef8c4fe66ae6 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 200 len: 1732 microversion: 2.20 time: 0.155852 Dec 15 13:41:08.449813 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 635/1252] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:41:08 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:41:08.643228 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-88fecf5b-b706-4fd0-96bd-d01f28f3c3bf tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 14.714193 Dec 15 13:41:08.643842 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 618/1253] 10.222.0.60 () {60 vars in 1322 bytes} [Wed Dec 15 13:40:53 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/os-volume_attachments => generated 194 bytes in 14716 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:41:09.467680 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-d585af24-12d5-427e-8243-29ed77538715 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:09.468295 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-d585af24-12d5-427e-8243-29ed77538715 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:09.474594 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d585af24-12d5-427e-8243-29ed77538715 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:09.475082 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d585af24-12d5-427e-8243-29ed77538715 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:09.475865 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d585af24-12d5-427e-8243-29ed77538715 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:09.476311 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d585af24-12d5-427e-8243-29ed77538715 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:09.604867 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-d585af24-12d5-427e-8243-29ed77538715 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:09.612471 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-d585af24-12d5-427e-8243-29ed77538715 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:09.613954 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-d585af24-12d5-427e-8243-29ed77538715 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:09.615121 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-d585af24-12d5-427e-8243-29ed77538715 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 200 len: 1732 microversion: 2.20 time: 0.151792 Dec 15 13:41:09.615686 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 636/1254] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:41:09 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:41:10.634156 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-3f532ccd-a7e9-43f4-b6bf-2c433052a7f7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:10.634871 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-3f532ccd-a7e9-43f4-b6bf-2c433052a7f7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:10.641947 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3f532ccd-a7e9-43f4-b6bf-2c433052a7f7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:10.642405 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3f532ccd-a7e9-43f4-b6bf-2c433052a7f7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:10.643207 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3f532ccd-a7e9-43f4-b6bf-2c433052a7f7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:10.643643 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3f532ccd-a7e9-43f4-b6bf-2c433052a7f7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:10.778938 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-3f532ccd-a7e9-43f4-b6bf-2c433052a7f7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:10.787175 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-3f532ccd-a7e9-43f4-b6bf-2c433052a7f7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:10.788886 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-3f532ccd-a7e9-43f4-b6bf-2c433052a7f7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:10.790104 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-3f532ccd-a7e9-43f4-b6bf-2c433052a7f7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 200 len: 1732 microversion: 2.20 time: 0.160026 Dec 15 13:41:10.790935 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 619/1255] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:41:10 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:41:11.807406 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-7a7d53bb-86e7-4c88-8d39-6f6f1cd1d36b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:11.807901 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-7a7d53bb-86e7-4c88-8d39-6f6f1cd1d36b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:11.814172 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7a7d53bb-86e7-4c88-8d39-6f6f1cd1d36b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:11.814664 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7a7d53bb-86e7-4c88-8d39-6f6f1cd1d36b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:11.815491 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7a7d53bb-86e7-4c88-8d39-6f6f1cd1d36b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:11.815933 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7a7d53bb-86e7-4c88-8d39-6f6f1cd1d36b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:11.944012 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-7a7d53bb-86e7-4c88-8d39-6f6f1cd1d36b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:11.952025 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-7a7d53bb-86e7-4c88-8d39-6f6f1cd1d36b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:11.953515 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-7a7d53bb-86e7-4c88-8d39-6f6f1cd1d36b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:11.954660 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-7a7d53bb-86e7-4c88-8d39-6f6f1cd1d36b tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 200 len: 1732 microversion: 2.20 time: 0.151078 Dec 15 13:41:11.955257 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 637/1256] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:41:11 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:41:12.933573 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-2663fabd-af32-4ae9-9c3f-d08e59af3481 req-fc21c628-e17f-4918-91a5-0cb8aafb01f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6", "name": "network-vif-plugged", "status": "completed", "tag": "836e8497-8739-4936-a7da-9c197bf1d072"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:12.935241 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:41:12.935241 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: warnings.warn(msg) Dec 15 13:41:12.942635 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-2663fabd-af32-4ae9-9c3f-d08e59af3481 req-fc21c628-e17f-4918-91a5-0cb8aafb01f3 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:12.943020 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-2663fabd-af32-4ae9-9c3f-d08e59af3481 req-fc21c628-e17f-4918-91a5-0cb8aafb01f3 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:12.953885 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-2663fabd-af32-4ae9-9c3f-d08e59af3481 req-fc21c628-e17f-4918-91a5-0cb8aafb01f3 service nova] Creating event network-vif-plugged:836e8497-8739-4936-a7da-9c197bf1d072 for instance f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 on hv-cinder-81322 Dec 15 13:41:12.958870 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-2663fabd-af32-4ae9-9c3f-d08e59af3481 req-fc21c628-e17f-4918-91a5-0cb8aafb01f3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028679 Dec 15 13:41:12.959491 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 620/1257] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:41:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:41:12.973343 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-fb1a661a-43f7-4137-9ce7-3d784ffb18a9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:12.973959 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-fb1a661a-43f7-4137-9ce7-3d784ffb18a9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:12.982491 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-fb1a661a-43f7-4137-9ce7-3d784ffb18a9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:12.983099 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-fb1a661a-43f7-4137-9ce7-3d784ffb18a9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:12.984077 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-fb1a661a-43f7-4137-9ce7-3d784ffb18a9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:12.984584 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-fb1a661a-43f7-4137-9ce7-3d784ffb18a9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:13.126217 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-fb1a661a-43f7-4137-9ce7-3d784ffb18a9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:13.134233 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-fb1a661a-43f7-4137-9ce7-3d784ffb18a9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:13.136391 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-fb1a661a-43f7-4137-9ce7-3d784ffb18a9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:13.137563 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-fb1a661a-43f7-4137-9ce7-3d784ffb18a9 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 200 len: 1732 microversion: 2.20 time: 0.168114 Dec 15 13:41:13.138133 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 638/1258] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:41:12 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:41:14.156755 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-f2a3c427-9c56-44b9-93f3-a503371147e7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:14.157371 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-f2a3c427-9c56-44b9-93f3-a503371147e7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:14.163543 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f2a3c427-9c56-44b9-93f3-a503371147e7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:14.163998 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f2a3c427-9c56-44b9-93f3-a503371147e7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:14.164777 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f2a3c427-9c56-44b9-93f3-a503371147e7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:14.165214 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f2a3c427-9c56-44b9-93f3-a503371147e7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:14.297172 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-f2a3c427-9c56-44b9-93f3-a503371147e7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:14.304827 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-f2a3c427-9c56-44b9-93f3-a503371147e7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:14.306322 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-f2a3c427-9c56-44b9-93f3-a503371147e7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:14.307517 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-f2a3c427-9c56-44b9-93f3-a503371147e7 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 200 len: 1732 microversion: 2.20 time: 0.155393 Dec 15 13:41:14.308100 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 621/1259] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:41:14 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:41:15.325464 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-08b59b7c-413d-4935-be8e-28bdf5f8fbdf tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:15.326067 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-08b59b7c-413d-4935-be8e-28bdf5f8fbdf tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:15.332271 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-08b59b7c-413d-4935-be8e-28bdf5f8fbdf tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:15.332727 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-08b59b7c-413d-4935-be8e-28bdf5f8fbdf tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:15.333772 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-08b59b7c-413d-4935-be8e-28bdf5f8fbdf tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:15.334209 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-08b59b7c-413d-4935-be8e-28bdf5f8fbdf tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:15.474285 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-08b59b7c-413d-4935-be8e-28bdf5f8fbdf tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:15.482123 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-08b59b7c-413d-4935-be8e-28bdf5f8fbdf tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:15.483657 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-08b59b7c-413d-4935-be8e-28bdf5f8fbdf tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:15.484807 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-08b59b7c-413d-4935-be8e-28bdf5f8fbdf tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 200 len: 1719 microversion: 2.20 time: 0.163092 Dec 15 13:41:15.485375 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 639/1260] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:41:15 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 1719 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:41:16.102769 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-3e198428-d9e0-4049-934c-774aa7385701 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:16.103726 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-3e198428-d9e0-4049-934c-774aa7385701 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:16.110167 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3e198428-d9e0-4049-934c-774aa7385701 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:16.110622 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3e198428-d9e0-4049-934c-774aa7385701 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:16.111517 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3e198428-d9e0-4049-934c-774aa7385701 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:16.111941 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3e198428-d9e0-4049-934c-774aa7385701 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:16.141956 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-3e198428-d9e0-4049-934c-774aa7385701 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042958 Dec 15 13:41:16.142521 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 622/1261] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Dec 15 13:41:16 2021] GET /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:41:16.152102 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-f0f61131-8d34-4744-916b-186c83577140 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:16.152595 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-f0f61131-8d34-4744-916b-186c83577140 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:16.158392 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f0f61131-8d34-4744-916b-186c83577140 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:16.158876 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f0f61131-8d34-4744-916b-186c83577140 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:16.159663 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f0f61131-8d34-4744-916b-186c83577140 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:16.160104 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f0f61131-8d34-4744-916b-186c83577140 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:16.188859 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-f0f61131-8d34-4744-916b-186c83577140 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/os-volume_attachments/f69ebf18-0983-4788-976f-411a9aec7f7b" status: 200 len: 194 microversion: 2.1 time: 0.040450 Dec 15 13:41:16.189453 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 640/1262] 10.222.0.60 () {58 vars in 1412 bytes} [Wed Dec 15 13:41:16 2021] GET /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/os-volume_attachments/f69ebf18-0983-4788-976f-411a9aec7f7b => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:41:17.480033 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-57cc9fa2-2342-4d82-a0d8-14bad72a6501 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b02542d-780b-4ee5-94c9-1775d79a907b"}} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:17.481101 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-57cc9fa2-2342-4d82-a0d8-14bad72a6501 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:17.487590 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-57cc9fa2-2342-4d82-a0d8-14bad72a6501 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:17.488054 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-57cc9fa2-2342-4d82-a0d8-14bad72a6501 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:17.488851 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-57cc9fa2-2342-4d82-a0d8-14bad72a6501 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:17.489295 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-57cc9fa2-2342-4d82-a0d8-14bad72a6501 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:17.716473 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-57cc9fa2-2342-4d82-a0d8-14bad72a6501 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.240038 Dec 15 13:41:17.717249 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 623/1263] 10.222.0.60 () {60 vars in 1322 bytes} [Wed Dec 15 13:41:17 2021] POST /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/os-volume_attachments => generated 194 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:41:25.167288 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ed2b1501-baf7-447e-b6d5-81f4a596c912 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:25.168263 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ed2b1501-baf7-447e-b6d5-81f4a596c912 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:25.174517 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ed2b1501-baf7-447e-b6d5-81f4a596c912 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:25.174953 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ed2b1501-baf7-447e-b6d5-81f4a596c912 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:25.175728 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ed2b1501-baf7-447e-b6d5-81f4a596c912 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:25.176160 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ed2b1501-baf7-447e-b6d5-81f4a596c912 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:25.205329 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ed2b1501-baf7-447e-b6d5-81f4a596c912 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041719 Dec 15 13:41:25.205870 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 641/1264] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Dec 15 13:41:25 2021] GET /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:41:25.433779 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-e527bd2f-dc2d-4a19-8cbb-89a0117c0ef4 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:25.434308 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-e527bd2f-dc2d-4a19-8cbb-89a0117c0ef4 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:25.440867 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e527bd2f-dc2d-4a19-8cbb-89a0117c0ef4 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:25.441318 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e527bd2f-dc2d-4a19-8cbb-89a0117c0ef4 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:25.442093 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e527bd2f-dc2d-4a19-8cbb-89a0117c0ef4 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:25.442526 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e527bd2f-dc2d-4a19-8cbb-89a0117c0ef4 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:25.471499 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-e527bd2f-dc2d-4a19-8cbb-89a0117c0ef4 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/os-volume_attachments/f69ebf18-0983-4788-976f-411a9aec7f7b" status: 200 len: 194 microversion: 2.1 time: 0.041937 Dec 15 13:41:25.472077 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 624/1265] 10.222.0.60 () {58 vars in 1412 bytes} [Wed Dec 15 13:41:25 2021] GET /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/os-volume_attachments/f69ebf18-0983-4788-976f-411a9aec7f7b => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:41:25.481235 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-73984ffc-da8a-470a-abdb-f3454e67cdd1 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:25.481736 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-73984ffc-da8a-470a-abdb-f3454e67cdd1 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:25.487859 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-73984ffc-da8a-470a-abdb-f3454e67cdd1 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:25.488319 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-73984ffc-da8a-470a-abdb-f3454e67cdd1 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:25.489107 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-73984ffc-da8a-470a-abdb-f3454e67cdd1 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:25.489550 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-73984ffc-da8a-470a-abdb-f3454e67cdd1 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:25.564958 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.objects.instance [None req-73984ffc-da8a-470a-abdb-f3454e67cdd1 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lazy-loading 'services' on Instance uuid 11606c02-c86d-4be7-af13-296b7061f769 {{(pid=116942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:41:25.632410 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-73984ffc-da8a-470a-abdb-f3454e67cdd1 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "DELETE /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/os-volume_attachments/f69ebf18-0983-4788-976f-411a9aec7f7b" status: 202 len: 0 microversion: 2.1 time: 0.154718 Dec 15 13:41:25.633203 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 642/1266] 10.222.0.60 () {58 vars in 1415 bytes} [Wed Dec 15 13:41:25 2021] DELETE /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/os-volume_attachments/f69ebf18-0983-4788-976f-411a9aec7f7b => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:41:27.794092 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-57d3c332-372f-433b-8c36-3079f3543d05 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:27.794601 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-57d3c332-372f-433b-8c36-3079f3543d05 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:27.800792 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-57d3c332-372f-433b-8c36-3079f3543d05 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:27.801245 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-57d3c332-372f-433b-8c36-3079f3543d05 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:27.802027 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-57d3c332-372f-433b-8c36-3079f3543d05 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:27.802468 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-57d3c332-372f-433b-8c36-3079f3543d05 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:27.831465 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-57d3c332-372f-433b-8c36-3079f3543d05 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/os-volume_attachments/5b02542d-780b-4ee5-94c9-1775d79a907b" status: 200 len: 194 microversion: 2.1 time: 0.041065 Dec 15 13:41:27.832052 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 625/1267] 10.222.0.60 () {58 vars in 1412 bytes} [Wed Dec 15 13:41:27 2021] GET /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/os-volume_attachments/5b02542d-780b-4ee5-94c9-1775d79a907b => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:41:27.842967 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-93a977a6-0b19-4106-816b-e4d631e70cb5 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:27.843556 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-93a977a6-0b19-4106-816b-e4d631e70cb5 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:27.849971 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-93a977a6-0b19-4106-816b-e4d631e70cb5 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:27.850432 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-93a977a6-0b19-4106-816b-e4d631e70cb5 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:27.851260 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-93a977a6-0b19-4106-816b-e4d631e70cb5 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:27.851706 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-93a977a6-0b19-4106-816b-e4d631e70cb5 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:27.927526 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.objects.instance [None req-93a977a6-0b19-4106-816b-e4d631e70cb5 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lazy-loading 'services' on Instance uuid 11606c02-c86d-4be7-af13-296b7061f769 {{(pid=116942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:41:27.994205 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-93a977a6-0b19-4106-816b-e4d631e70cb5 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "DELETE /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/os-volume_attachments/5b02542d-780b-4ee5-94c9-1775d79a907b" status: 202 len: 0 microversion: 2.1 time: 0.155718 Dec 15 13:41:27.994921 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 643/1268] 10.222.0.60 () {58 vars in 1415 bytes} [Wed Dec 15 13:41:27 2021] DELETE /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/os-volume_attachments/5b02542d-780b-4ee5-94c9-1775d79a907b => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:41:29.144651 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-6f7a3c21-13f6-42b4-aa6d-d4a1deed0590 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:29.145620 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-6f7a3c21-13f6-42b4-aa6d-d4a1deed0590 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:29.151830 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6f7a3c21-13f6-42b4-aa6d-d4a1deed0590 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:29.152277 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6f7a3c21-13f6-42b4-aa6d-d4a1deed0590 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:29.153049 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6f7a3c21-13f6-42b4-aa6d-d4a1deed0590 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:29.153485 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-6f7a3c21-13f6-42b4-aa6d-d4a1deed0590 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:29.181398 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-6f7a3c21-13f6-42b4-aa6d-d4a1deed0590 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040487 Dec 15 13:41:29.181884 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 626/1269] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Dec 15 13:41:29 2021] GET /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:41:29.278776 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ff3a0a24-9791-4f3d-9edd-441c1c9f2f39 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:29.279851 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ff3a0a24-9791-4f3d-9edd-441c1c9f2f39 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:29.286018 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ff3a0a24-9791-4f3d-9edd-441c1c9f2f39 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:29.286475 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ff3a0a24-9791-4f3d-9edd-441c1c9f2f39 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:29.287309 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ff3a0a24-9791-4f3d-9edd-441c1c9f2f39 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:29.287755 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ff3a0a24-9791-4f3d-9edd-441c1c9f2f39 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:29.315855 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ff3a0a24-9791-4f3d-9edd-441c1c9f2f39 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042037 Dec 15 13:41:29.316420 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 644/1270] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Dec 15 13:41:29 2021] GET /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:41:29.378484 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-43cf34ba-c779-44e3-8af6-e533300a1702 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:29.379020 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-43cf34ba-c779-44e3-8af6-e533300a1702 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:29.384687 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-43cf34ba-c779-44e3-8af6-e533300a1702 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:29.385140 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-43cf34ba-c779-44e3-8af6-e533300a1702 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:29.387810 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-43cf34ba-c779-44e3-8af6-e533300a1702 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:29.388283 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-43cf34ba-c779-44e3-8af6-e533300a1702 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:29.414288 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-43cf34ba-c779-44e3-8af6-e533300a1702 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Going to try to terminate instance {{(pid=116941) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:41:29.484733 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-43cf34ba-c779-44e3-8af6-e533300a1702 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "DELETE /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769" status: 204 len: 0 microversion: 2.1 time: 0.109584 Dec 15 13:41:29.485334 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 627/1271] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Dec 15 13:41:29 2021] DELETE /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:41:29.493257 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-4b759983-8c9b-4976-83bf-27919209e5b8 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:29.493934 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-4b759983-8c9b-4976-83bf-27919209e5b8 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:29.499758 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4b759983-8c9b-4976-83bf-27919209e5b8 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:29.500211 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4b759983-8c9b-4976-83bf-27919209e5b8 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:29.500994 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4b759983-8c9b-4976-83bf-27919209e5b8 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:29.501436 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4b759983-8c9b-4976-83bf-27919209e5b8 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:29.850709 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-4b759983-8c9b-4976-83bf-27919209e5b8 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:29.858094 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-4b759983-8c9b-4976-83bf-27919209e5b8 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769" status: 200 len: 1672 microversion: 2.1 time: 0.368530 Dec 15 13:41:29.858673 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 645/1272] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:41:29 2021] GET /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769 => generated 1672 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:41:30.875659 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-5adefc57-5143-474d-8060-f4282a531bed tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:30.876373 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-5adefc57-5143-474d-8060-f4282a531bed tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:30.882653 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5adefc57-5143-474d-8060-f4282a531bed tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:30.883161 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5adefc57-5143-474d-8060-f4282a531bed tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:30.883960 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5adefc57-5143-474d-8060-f4282a531bed tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:30.884402 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5adefc57-5143-474d-8060-f4282a531bed tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:31.011974 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-5adefc57-5143-474d-8060-f4282a531bed tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:31.021956 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-5adefc57-5143-474d-8060-f4282a531bed tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769" status: 200 len: 1672 microversion: 2.1 time: 0.150331 Dec 15 13:41:31.022540 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 628/1273] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:41:30 2021] GET /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769 => generated 1672 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:41:32.042456 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-9496d6ca-1077-4e8e-801e-a7d6218f52b5 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:32.043197 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-9496d6ca-1077-4e8e-801e-a7d6218f52b5 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:32.049538 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9496d6ca-1077-4e8e-801e-a7d6218f52b5 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:32.050000 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9496d6ca-1077-4e8e-801e-a7d6218f52b5 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:32.050834 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9496d6ca-1077-4e8e-801e-a7d6218f52b5 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:32.051298 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9496d6ca-1077-4e8e-801e-a7d6218f52b5 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:32.183425 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-9496d6ca-1077-4e8e-801e-a7d6218f52b5 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f51c315df74089bc6873e889cf80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde9c0e34334ad7a7e79bfeb8963935', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:32.190834 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-9496d6ca-1077-4e8e-801e-a7d6218f52b5 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769" status: 200 len: 1672 microversion: 2.1 time: 0.152093 Dec 15 13:41:32.191432 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 646/1274] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:41:32 2021] GET /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769 => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:41:32.513518 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-bd0931a4-afdd-41d9-bc96-0ccc895ec117 req-87507af6-93c9-49a6-a3d3-d199a980f466 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11606c02-c86d-4be7-af13-296b7061f769", "name": "network-vif-deleted", "tag": "b79a2306-1e2f-41f0-8f14-42fe5c03e832"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:32.515862 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:41:32.515862 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: warnings.warn(msg) Dec 15 13:41:32.525417 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-bd0931a4-afdd-41d9-bc96-0ccc895ec117 req-87507af6-93c9-49a6-a3d3-d199a980f466 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:32.525865 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-bd0931a4-afdd-41d9-bc96-0ccc895ec117 req-87507af6-93c9-49a6-a3d3-d199a980f466 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:32.539671 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-bd0931a4-afdd-41d9-bc96-0ccc895ec117 req-87507af6-93c9-49a6-a3d3-d199a980f466 service nova] Creating event network-vif-deleted:b79a2306-1e2f-41f0-8f14-42fe5c03e832 for instance 11606c02-c86d-4be7-af13-296b7061f769 on hv-cinder-81322 Dec 15 13:41:32.544678 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-bd0931a4-afdd-41d9-bc96-0ccc895ec117 req-87507af6-93c9-49a6-a3d3-d199a980f466 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035552 Dec 15 13:41:32.545725 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 629/1275] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:41:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:41:33.208842 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-919d126e-df98-4522-9d60-9b29c02baa9f tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:33.209497 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-919d126e-df98-4522-9d60-9b29c02baa9f tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:33.216464 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-919d126e-df98-4522-9d60-9b29c02baa9f tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:33.216919 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-919d126e-df98-4522-9d60-9b29c02baa9f tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:33.217707 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-919d126e-df98-4522-9d60-9b29c02baa9f tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:33.218147 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-919d126e-df98-4522-9d60-9b29c02baa9f tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:33.231843 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.wsgi [None req-919d126e-df98-4522-9d60-9b29c02baa9f tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] HTTP exception thrown: Instance 11606c02-c86d-4be7-af13-296b7061f769 could not be found. Dec 15 13:41:33.232436 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-919d126e-df98-4522-9d60-9b29c02baa9f tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Returning 404 to user: Instance 11606c02-c86d-4be7-af13-296b7061f769 could not be found. {{(pid=116942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:41:33.233265 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-919d126e-df98-4522-9d60-9b29c02baa9f tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769" status: 404 len: 111 microversion: 2.1 time: 0.028254 Dec 15 13:41:33.233815 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 647/1276] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:41:33 2021] GET /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:41:33.242512 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-39537f6b-6110-4886-b3e7-f74de903d889 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '.version_select at 0x7ff514033160>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:33.259305 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-39537f6b-6110-4886-b3e7-f74de903d889 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-467884376" status: 202 len: 0 microversion: 2.1 time: 0.020668 Dec 15 13:41:33.259894 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 630/1277] 10.222.0.60 () {58 vars in 1217 bytes} [Wed Dec 15 13:41:33 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-467884376 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:41:36.166777 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-041e997d-d6e0-4b1e-a998-f127944eb339 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:36.167944 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-041e997d-d6e0-4b1e-a998-f127944eb339 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:36.174199 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-041e997d-d6e0-4b1e-a998-f127944eb339 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:36.174651 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-041e997d-d6e0-4b1e-a998-f127944eb339 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:36.175459 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-041e997d-d6e0-4b1e-a998-f127944eb339 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:36.175934 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-041e997d-d6e0-4b1e-a998-f127944eb339 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:36.189951 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.wsgi [None req-041e997d-d6e0-4b1e-a998-f127944eb339 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] HTTP exception thrown: Instance 11606c02-c86d-4be7-af13-296b7061f769 could not be found. Dec 15 13:41:36.190529 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-041e997d-d6e0-4b1e-a998-f127944eb339 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Returning 404 to user: Instance 11606c02-c86d-4be7-af13-296b7061f769 could not be found. {{(pid=116942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:41:36.191373 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-041e997d-d6e0-4b1e-a998-f127944eb339 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "DELETE /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769" status: 404 len: 111 microversion: 2.1 time: 0.028254 Dec 15 13:41:36.191897 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 648/1278] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Dec 15 13:41:36 2021] DELETE /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:41:36.199858 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-0e85dc63-b4c8-4c6d-89d3-3df575d003f2 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:36.200589 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-0e85dc63-b4c8-4c6d-89d3-3df575d003f2 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: 11606c02-c86d-4be7-af13-296b7061f769] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:36.206532 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0e85dc63-b4c8-4c6d-89d3-3df575d003f2 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:36.207044 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0e85dc63-b4c8-4c6d-89d3-3df575d003f2 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:36.207818 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0e85dc63-b4c8-4c6d-89d3-3df575d003f2 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:36.208272 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0e85dc63-b4c8-4c6d-89d3-3df575d003f2 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:36.223245 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.wsgi [None req-0e85dc63-b4c8-4c6d-89d3-3df575d003f2 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] HTTP exception thrown: Instance 11606c02-c86d-4be7-af13-296b7061f769 could not be found. Dec 15 13:41:36.223824 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-0e85dc63-b4c8-4c6d-89d3-3df575d003f2 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Returning 404 to user: Instance 11606c02-c86d-4be7-af13-296b7061f769 could not be found. {{(pid=116941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:41:36.224627 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-0e85dc63-b4c8-4c6d-89d3-3df575d003f2 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769" status: 404 len: 111 microversion: 2.1 time: 0.028948 Dec 15 13:41:36.225148 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 631/1279] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:41:36 2021] GET /compute/v2.1/servers/11606c02-c86d-4be7-af13-296b7061f769 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:41:37.352350 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-a880e83d-0380-4be9-b39f-f6d9e95af6ca tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:37.352844 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-a880e83d-0380-4be9-b39f-f6d9e95af6ca tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:37.359505 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a880e83d-0380-4be9-b39f-f6d9e95af6ca tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:37.359963 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a880e83d-0380-4be9-b39f-f6d9e95af6ca tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:37.360741 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a880e83d-0380-4be9-b39f-f6d9e95af6ca tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:37.361183 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a880e83d-0380-4be9-b39f-f6d9e95af6ca tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:37.374542 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.wsgi [None req-a880e83d-0380-4be9-b39f-f6d9e95af6ca tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] HTTP exception thrown: Instance ef0157ed-5d02-45a9-9160-55cc033a16ec could not be found. Dec 15 13:41:37.375163 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-a880e83d-0380-4be9-b39f-f6d9e95af6ca tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Returning 404 to user: Instance ef0157ed-5d02-45a9-9160-55cc033a16ec could not be found. {{(pid=116942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:41:37.376002 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-a880e83d-0380-4be9-b39f-f6d9e95af6ca tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 404 len: 111 microversion: 2.1 time: 0.027329 Dec 15 13:41:37.376526 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 649/1280] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Dec 15 13:41:37 2021] DELETE /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:41:37.384059 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-a74477a0-3970-43ef-a97b-520a14943e27 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:37.384675 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-a74477a0-3970-43ef-a97b-520a14943e27 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] [instance: ef0157ed-5d02-45a9-9160-55cc033a16ec] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:37.390830 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a74477a0-3970-43ef-a97b-520a14943e27 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:37.391306 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a74477a0-3970-43ef-a97b-520a14943e27 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:37.392087 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a74477a0-3970-43ef-a97b-520a14943e27 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:37.392524 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a74477a0-3970-43ef-a97b-520a14943e27 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:37.405373 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.wsgi [None req-a74477a0-3970-43ef-a97b-520a14943e27 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] HTTP exception thrown: Instance ef0157ed-5d02-45a9-9160-55cc033a16ec could not be found. Dec 15 13:41:37.405947 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-a74477a0-3970-43ef-a97b-520a14943e27 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] Returning 404 to user: Instance ef0157ed-5d02-45a9-9160-55cc033a16ec could not be found. {{(pid=116941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:41:37.406747 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-a74477a0-3970-43ef-a97b-520a14943e27 tempest-AttachVolumeTestJSON-1319480055 tempest-AttachVolumeTestJSON-1319480055-project] 10.222.0.60 "GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec" status: 404 len: 111 microversion: 2.1 time: 0.026404 Dec 15 13:41:37.407288 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 632/1281] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:41:37 2021] GET /compute/v2.1/servers/ef0157ed-5d02-45a9-9160-55cc033a16ec => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:42:10.939552 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-e97f2d73-4a0e-4392-8c84-0fe71455dbca tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:10.940544 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-e97f2d73-4a0e-4392-8c84-0fe71455dbca tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:10.946391 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e97f2d73-4a0e-4392-8c84-0fe71455dbca tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:10.946869 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e97f2d73-4a0e-4392-8c84-0fe71455dbca tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:10.947679 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e97f2d73-4a0e-4392-8c84-0fe71455dbca tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:10.948138 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e97f2d73-4a0e-4392-8c84-0fe71455dbca tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:10.978309 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-e97f2d73-4a0e-4392-8c84-0fe71455dbca tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042616 Dec 15 13:42:10.978903 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 650/1282] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Dec 15 13:42:10 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:42:11.044364 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-c9fbe915-317c-4cba-9b63-a6007d28bf6c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:11.044894 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-c9fbe915-317c-4cba-9b63-a6007d28bf6c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:11.051525 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c9fbe915-317c-4cba-9b63-a6007d28bf6c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:11.051983 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c9fbe915-317c-4cba-9b63-a6007d28bf6c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:11.052775 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c9fbe915-317c-4cba-9b63-a6007d28bf6c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:11.053218 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-c9fbe915-317c-4cba-9b63-a6007d28bf6c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:11.078022 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-c9fbe915-317c-4cba-9b63-a6007d28bf6c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Going to try to terminate instance {{(pid=116941) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:42:11.151078 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-c9fbe915-317c-4cba-9b63-a6007d28bf6c tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 204 len: 0 microversion: 2.20 time: 0.110399 Dec 15 13:42:11.151991 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 633/1283] 10.222.0.60 () {60 vars in 1279 bytes} [Wed Dec 15 13:42:11 2021] DELETE /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 15 13:42:11.161531 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-814cec9e-0a89-4366-8026-610dbf802ff2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:11.162350 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-814cec9e-0a89-4366-8026-610dbf802ff2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:11.168751 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-814cec9e-0a89-4366-8026-610dbf802ff2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:11.168977 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-814cec9e-0a89-4366-8026-610dbf802ff2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:11.170034 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-814cec9e-0a89-4366-8026-610dbf802ff2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:11.170480 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-814cec9e-0a89-4366-8026-610dbf802ff2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:11.309031 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-814cec9e-0a89-4366-8026-610dbf802ff2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:11.321763 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-814cec9e-0a89-4366-8026-610dbf802ff2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:11.324525 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-814cec9e-0a89-4366-8026-610dbf802ff2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:11.326325 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-814cec9e-0a89-4366-8026-610dbf802ff2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 200 len: 1725 microversion: 2.20 time: 0.170108 Dec 15 13:42:11.327296 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 651/1284] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:42:11 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:42:12.348731 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-810a12c3-cb77-4bd9-8139-d1bcc249e3fa tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:12.349426 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-810a12c3-cb77-4bd9-8139-d1bcc249e3fa tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:12.355628 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-810a12c3-cb77-4bd9-8139-d1bcc249e3fa tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:12.356077 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-810a12c3-cb77-4bd9-8139-d1bcc249e3fa tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:12.356850 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-810a12c3-cb77-4bd9-8139-d1bcc249e3fa tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:12.357282 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-810a12c3-cb77-4bd9-8139-d1bcc249e3fa tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:12.729768 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-810a12c3-cb77-4bd9-8139-d1bcc249e3fa tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:12.739527 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-810a12c3-cb77-4bd9-8139-d1bcc249e3fa tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:12.741543 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-810a12c3-cb77-4bd9-8139-d1bcc249e3fa tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:12.742947 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-810a12c3-cb77-4bd9-8139-d1bcc249e3fa tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 200 len: 1725 microversion: 2.20 time: 0.398208 Dec 15 13:42:12.743707 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 634/1285] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:42:12 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 1725 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:42:13.770347 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-038d26d1-5e12-4cc5-a89f-e70af47ed2c3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:13.771040 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-038d26d1-5e12-4cc5-a89f-e70af47ed2c3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:13.780521 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-038d26d1-5e12-4cc5-a89f-e70af47ed2c3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:13.781505 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-038d26d1-5e12-4cc5-a89f-e70af47ed2c3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:13.782323 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-038d26d1-5e12-4cc5-a89f-e70af47ed2c3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:13.782817 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-038d26d1-5e12-4cc5-a89f-e70af47ed2c3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:13.849186 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-038d26d1-5e12-4cc5-a89f-e70af47ed2c3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:13.858178 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-038d26d1-5e12-4cc5-a89f-e70af47ed2c3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:13.859760 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-038d26d1-5e12-4cc5-a89f-e70af47ed2c3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58ad05b9c93c48a4bf4d1f086b6d5ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d4c797afe475aa474e4415f6190c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:13.860935 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-038d26d1-5e12-4cc5-a89f-e70af47ed2c3 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 200 len: 1657 microversion: 2.20 time: 0.102269 Dec 15 13:42:13.861532 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 652/1286] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:42:13 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 1657 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:42:14.505719 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-3aaf36b5-1a6c-4e4a-af7c-b33a56fa9532 req-c8dc7c42-0697-4d25-ae6c-cf79f403c31d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6", "name": "network-vif-deleted", "tag": "836e8497-8739-4936-a7da-9c197bf1d072"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:42:14.507403 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:42:14.507403 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: warnings.warn(msg) Dec 15 13:42:14.515141 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-3aaf36b5-1a6c-4e4a-af7c-b33a56fa9532 req-c8dc7c42-0697-4d25-ae6c-cf79f403c31d service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:14.516418 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-3aaf36b5-1a6c-4e4a-af7c-b33a56fa9532 req-c8dc7c42-0697-4d25-ae6c-cf79f403c31d service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:14.527487 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-3aaf36b5-1a6c-4e4a-af7c-b33a56fa9532 req-c8dc7c42-0697-4d25-ae6c-cf79f403c31d service nova] Creating event network-vif-deleted:836e8497-8739-4936-a7da-9c197bf1d072 for instance f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 on hv-cinder-81322 Dec 15 13:42:14.533365 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-3aaf36b5-1a6c-4e4a-af7c-b33a56fa9532 req-c8dc7c42-0697-4d25-ae6c-cf79f403c31d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.282142 Dec 15 13:42:14.534544 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 635/1287] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:42:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:42:14.882730 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-89b5e58b-3fbe-498c-ad3a-b6191911a88a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:14.884275 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-89b5e58b-3fbe-498c-ad3a-b6191911a88a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:14.894198 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-89b5e58b-3fbe-498c-ad3a-b6191911a88a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:14.894823 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-89b5e58b-3fbe-498c-ad3a-b6191911a88a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:14.895758 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-89b5e58b-3fbe-498c-ad3a-b6191911a88a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:14.896328 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-89b5e58b-3fbe-498c-ad3a-b6191911a88a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:14.911138 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.wsgi [None req-89b5e58b-3fbe-498c-ad3a-b6191911a88a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] HTTP exception thrown: Instance f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 could not be found. Dec 15 13:42:14.912154 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-89b5e58b-3fbe-498c-ad3a-b6191911a88a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Returning 404 to user: Instance f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 could not be found. {{(pid=116942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:42:14.913104 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-89b5e58b-3fbe-498c-ad3a-b6191911a88a tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 404 len: 111 microversion: 2.20 time: 0.036799 Dec 15 13:42:14.913801 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 653/1288] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:42:14 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 15 13:42:14.923483 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-09283a0e-a49f-43dc-bace-ef51e3575c2e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '.version_select at 0x7ff50f3c64c0>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:14.943368 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-09283a0e-a49f-43dc-bace-ef51e3575c2e tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-135306928" status: 204 len: 0 microversion: 2.20 time: 0.024446 Dec 15 13:42:14.944178 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 636/1289] 10.222.0.60 () {60 vars in 1258 bytes} [Wed Dec 15 13:42:14 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-135306928 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 15 13:42:16.965481 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-152722da-2b12-4bc2-99f3-fb983bfa0ad2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:16.966746 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-152722da-2b12-4bc2-99f3-fb983bfa0ad2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:16.980998 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-152722da-2b12-4bc2-99f3-fb983bfa0ad2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:16.981826 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-152722da-2b12-4bc2-99f3-fb983bfa0ad2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:16.983134 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-152722da-2b12-4bc2-99f3-fb983bfa0ad2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:16.983811 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-152722da-2b12-4bc2-99f3-fb983bfa0ad2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:17.016599 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.wsgi [None req-152722da-2b12-4bc2-99f3-fb983bfa0ad2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] HTTP exception thrown: Instance f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 could not be found. Dec 15 13:42:17.017212 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-152722da-2b12-4bc2-99f3-fb983bfa0ad2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Returning 404 to user: Instance f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 could not be found. {{(pid=116942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:42:17.018132 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-152722da-2b12-4bc2-99f3-fb983bfa0ad2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 404 len: 111 microversion: 2.20 time: 0.064944 Dec 15 13:42:17.018791 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 654/1290] 10.222.0.60 () {60 vars in 1279 bytes} [Wed Dec 15 13:42:16 2021] DELETE /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 15 13:42:17.028404 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-9a46a1a5-4d8a-442f-a6f7-b66edcdaa731 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:17.029152 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-9a46a1a5-4d8a-442f-a6f7-b66edcdaa731 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:17.044170 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9a46a1a5-4d8a-442f-a6f7-b66edcdaa731 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:17.044885 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9a46a1a5-4d8a-442f-a6f7-b66edcdaa731 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:17.045793 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9a46a1a5-4d8a-442f-a6f7-b66edcdaa731 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:17.046336 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-9a46a1a5-4d8a-442f-a6f7-b66edcdaa731 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:17.074669 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.wsgi [None req-9a46a1a5-4d8a-442f-a6f7-b66edcdaa731 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] HTTP exception thrown: Instance f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 could not be found. Dec 15 13:42:17.075416 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-9a46a1a5-4d8a-442f-a6f7-b66edcdaa731 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Returning 404 to user: Instance f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 could not be found. {{(pid=116941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:42:17.076410 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-9a46a1a5-4d8a-442f-a6f7-b66edcdaa731 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6" status: 404 len: 111 microversion: 2.20 time: 0.053223 Dec 15 13:42:17.077095 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 637/1291] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:42:17 2021] GET /compute/v2.1/servers/f62e422e-fd9d-4fd8-9c9c-0ac0f4394fc6 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Dec 15 13:42:18.228818 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-158aebeb-f582-4a43-a1fd-951309b6fa74 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:18.230367 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-158aebeb-f582-4a43-a1fd-951309b6fa74 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:18.237936 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-158aebeb-f582-4a43-a1fd-951309b6fa74 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:18.238399 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-158aebeb-f582-4a43-a1fd-951309b6fa74 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:18.239241 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-158aebeb-f582-4a43-a1fd-951309b6fa74 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:18.239681 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-158aebeb-f582-4a43-a1fd-951309b6fa74 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:18.274006 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.wsgi [None req-158aebeb-f582-4a43-a1fd-951309b6fa74 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] HTTP exception thrown: Instance 00671676-47cb-4266-b9e5-61c7fb120355 could not be found. Dec 15 13:42:18.274949 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-158aebeb-f582-4a43-a1fd-951309b6fa74 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Returning 404 to user: Instance 00671676-47cb-4266-b9e5-61c7fb120355 could not be found. {{(pid=116942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:42:18.276095 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-158aebeb-f582-4a43-a1fd-951309b6fa74 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "DELETE /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 404 len: 111 microversion: 2.20 time: 0.051635 Dec 15 13:42:18.277445 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 655/1292] 10.222.0.60 () {60 vars in 1279 bytes} [Wed Dec 15 13:42:18 2021] DELETE /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 15 13:42:18.285026 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-e9ee4efb-8f3b-493c-96bb-b0dd553b9bf2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:18.286347 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-e9ee4efb-8f3b-493c-96bb-b0dd553b9bf2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] [instance: 00671676-47cb-4266-b9e5-61c7fb120355] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:18.298578 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e9ee4efb-8f3b-493c-96bb-b0dd553b9bf2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:18.303555 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e9ee4efb-8f3b-493c-96bb-b0dd553b9bf2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:18.305316 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e9ee4efb-8f3b-493c-96bb-b0dd553b9bf2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:18.307004 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e9ee4efb-8f3b-493c-96bb-b0dd553b9bf2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:18.337070 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.wsgi [None req-e9ee4efb-8f3b-493c-96bb-b0dd553b9bf2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] HTTP exception thrown: Instance 00671676-47cb-4266-b9e5-61c7fb120355 could not be found. Dec 15 13:42:18.338235 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-e9ee4efb-8f3b-493c-96bb-b0dd553b9bf2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] Returning 404 to user: Instance 00671676-47cb-4266-b9e5-61c7fb120355 could not be found. {{(pid=116941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:42:18.339260 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-e9ee4efb-8f3b-493c-96bb-b0dd553b9bf2 tempest-AttachVolumeShelveTestJSON-859735595 tempest-AttachVolumeShelveTestJSON-859735595-project] 10.222.0.60 "GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355" status: 404 len: 111 microversion: 2.20 time: 0.058006 Dec 15 13:42:18.340338 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 638/1293] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 13:42:18 2021] GET /compute/v2.1/servers/00671676-47cb-4266-b9e5-61c7fb120355 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Dec 15 13:42:23.699280 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-4f4bedb9-4777-47d0-bcd3-771d5e1aead2 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Action: 'create', calling method: .version_select at 0x7ff50ff10700>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-825054983"}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:42:23.715511 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-4f4bedb9-4777-47d0-bcd3-771d5e1aead2 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Getting quotas for project ff117078def64108b7829db8db9baf7f. Resources: {'key_pairs'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:42:23.719714 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-4f4bedb9-4777-47d0-bcd3-771d5e1aead2 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Getting quotas for user 484a37a0154a4f709815c5935aef8ec2 and project ff117078def64108b7829db8db9baf7f. Resources: {'key_pairs'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:42:23.870170 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-4f4bedb9-4777-47d0-bcd3-771d5e1aead2 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Getting quotas for project ff117078def64108b7829db8db9baf7f. Resources: {'key_pairs'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:42:23.874691 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-4f4bedb9-4777-47d0-bcd3-771d5e1aead2 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Getting quotas for user 484a37a0154a4f709815c5935aef8ec2 and project ff117078def64108b7829db8db9baf7f. Resources: {'key_pairs'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:42:23.890224 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-4f4bedb9-4777-47d0-bcd3-771d5e1aead2 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.547837 Dec 15 13:42:23.891148 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 656/1294] 10.222.0.60 () {60 vars in 1157 bytes} [Wed Dec 15 13:42:23 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:42:26.808496 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-ba130c5e-7636-443a-91f2-3b905ca97e41 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:26.809548 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-ba130c5e-7636-443a-91f2-3b905ca97e41 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] [instance: b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:26.818097 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-cd490b1f-7f34-4dcf-8110-1c5b3da4f770 req-07a31d76-3e5f-4d9a-90d2-a81b48b915aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e", "tag": "271b8ee8-bedb-4be5-a4e3-37b1a376fe7f"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:42:26.819663 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:42:26.819663 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: warnings.warn(msg) Dec 15 13:42:26.822054 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ba130c5e-7636-443a-91f2-3b905ca97e41 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:26.836355 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ba130c5e-7636-443a-91f2-3b905ca97e41 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:26.837138 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-cd490b1f-7f34-4dcf-8110-1c5b3da4f770 req-07a31d76-3e5f-4d9a-90d2-a81b48b915aa service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:26.837780 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-cd490b1f-7f34-4dcf-8110-1c5b3da4f770 req-07a31d76-3e5f-4d9a-90d2-a81b48b915aa service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:26.841653 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ba130c5e-7636-443a-91f2-3b905ca97e41 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:26.842456 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ba130c5e-7636-443a-91f2-3b905ca97e41 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:26.862698 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-cd490b1f-7f34-4dcf-8110-1c5b3da4f770 req-07a31d76-3e5f-4d9a-90d2-a81b48b915aa service nova] Creating event network-changed:271b8ee8-bedb-4be5-a4e3-37b1a376fe7f for instance b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e on hv-cinder-81322 Dec 15 13:42:26.873159 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-cd490b1f-7f34-4dcf-8110-1c5b3da4f770 req-07a31d76-3e5f-4d9a-90d2-a81b48b915aa service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059160 Dec 15 13:42:26.879617 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 657/1295] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:42:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:42:26.893575 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-ba130c5e-7636-443a-91f2-3b905ca97e41 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] [instance: b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e] Going to try to terminate instance {{(pid=116941) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:42:27.061724 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-ba130c5e-7636-443a-91f2-3b905ca97e41 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e" status: 204 len: 0 microversion: 2.1 time: 0.258068 Dec 15 13:42:27.066973 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 639/1296] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Dec 15 13:42:26 2021] DELETE /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:42:27.077461 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-a4bb28e8-24f5-47df-94c5-ea0d40fdad34 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:27.078189 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-a4bb28e8-24f5-47df-94c5-ea0d40fdad34 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] [instance: b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:27.088954 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a4bb28e8-24f5-47df-94c5-ea0d40fdad34 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:27.089407 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a4bb28e8-24f5-47df-94c5-ea0d40fdad34 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:27.090213 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a4bb28e8-24f5-47df-94c5-ea0d40fdad34 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:27.099865 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a4bb28e8-24f5-47df-94c5-ea0d40fdad34 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:27.359539 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-a4bb28e8-24f5-47df-94c5-ea0d40fdad34 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7774ea10bce345cabd96a0c94eda98b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ac6d4548e486492887beb2e915bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:27.370228 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-a4bb28e8-24f5-47df-94c5-ea0d40fdad34 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] 10.222.0.60 "GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e" status: 200 len: 1566 microversion: 2.1 time: 0.302257 Dec 15 13:42:27.371800 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 658/1297] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:27 2021] GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e => generated 1566 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:42:28.389041 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-3cabfd44-f858-4a9e-b685-a140493e36cb tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:28.389866 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-3cabfd44-f858-4a9e-b685-a140493e36cb tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] [instance: b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:28.396469 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3cabfd44-f858-4a9e-b685-a140493e36cb tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:28.397004 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3cabfd44-f858-4a9e-b685-a140493e36cb tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:28.397887 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3cabfd44-f858-4a9e-b685-a140493e36cb tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:28.398430 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3cabfd44-f858-4a9e-b685-a140493e36cb tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:28.550560 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-3cabfd44-f858-4a9e-b685-a140493e36cb tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7774ea10bce345cabd96a0c94eda98b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ac6d4548e486492887beb2e915bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:28.558008 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-3cabfd44-f858-4a9e-b685-a140493e36cb tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] 10.222.0.60 "GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e" status: 200 len: 1448 microversion: 2.1 time: 0.173868 Dec 15 13:42:28.558578 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 640/1298] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:28 2021] GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e => generated 1448 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:42:29.414471 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-711a6b26-5dfb-46b8-ad5a-5cf98abd903b req-54ca474d-d4c0-41a6-9cb9-ad3043d45db6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e", "name": "network-vif-deleted", "tag": "271b8ee8-bedb-4be5-a4e3-37b1a376fe7f"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:42:29.416221 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:42:29.416221 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: warnings.warn(msg) Dec 15 13:42:29.432100 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-711a6b26-5dfb-46b8-ad5a-5cf98abd903b req-54ca474d-d4c0-41a6-9cb9-ad3043d45db6 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:29.432596 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-711a6b26-5dfb-46b8-ad5a-5cf98abd903b req-54ca474d-d4c0-41a6-9cb9-ad3043d45db6 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:29.445216 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-711a6b26-5dfb-46b8-ad5a-5cf98abd903b req-54ca474d-d4c0-41a6-9cb9-ad3043d45db6 service nova] Creating event network-vif-deleted:271b8ee8-bedb-4be5-a4e3-37b1a376fe7f for instance b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e on hv-cinder-81322 Dec 15 13:42:29.450310 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-711a6b26-5dfb-46b8-ad5a-5cf98abd903b req-54ca474d-d4c0-41a6-9cb9-ad3043d45db6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039478 Dec 15 13:42:29.451244 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 659/1299] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:42:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:42:29.574449 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-652200ed-eda8-401e-a780-ce71e6848d87 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:29.575049 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-652200ed-eda8-401e-a780-ce71e6848d87 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] [instance: b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:29.582902 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-652200ed-eda8-401e-a780-ce71e6848d87 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:29.583861 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-652200ed-eda8-401e-a780-ce71e6848d87 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:29.584839 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-652200ed-eda8-401e-a780-ce71e6848d87 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:29.585448 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-652200ed-eda8-401e-a780-ce71e6848d87 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:29.679830 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-652200ed-eda8-401e-a780-ce71e6848d87 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7774ea10bce345cabd96a0c94eda98b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ac6d4548e486492887beb2e915bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:29.688871 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-652200ed-eda8-401e-a780-ce71e6848d87 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] 10.222.0.60 "GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e" status: 200 len: 1218 microversion: 2.1 time: 0.117556 Dec 15 13:42:29.695053 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 641/1300] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:29 2021] GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e => generated 1218 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:42:30.711757 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-5cc066ad-c195-4272-a44c-8461fc77eb11 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:30.712460 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-5cc066ad-c195-4272-a44c-8461fc77eb11 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] [instance: b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:30.719409 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5cc066ad-c195-4272-a44c-8461fc77eb11 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:30.719874 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5cc066ad-c195-4272-a44c-8461fc77eb11 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:30.720859 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5cc066ad-c195-4272-a44c-8461fc77eb11 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:30.721311 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5cc066ad-c195-4272-a44c-8461fc77eb11 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:30.734724 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.wsgi [None req-5cc066ad-c195-4272-a44c-8461fc77eb11 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] HTTP exception thrown: Instance b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e could not be found. Dec 15 13:42:30.735363 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-5cc066ad-c195-4272-a44c-8461fc77eb11 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Returning 404 to user: Instance b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e could not be found. {{(pid=116942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:42:30.736329 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-5cc066ad-c195-4272-a44c-8461fc77eb11 tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] 10.222.0.60 "GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e" status: 404 len: 111 microversion: 2.1 time: 0.028892 Dec 15 13:42:30.736876 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 660/1301] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:30 2021] GET /compute/v2.1/servers/b4ee07b3-5ab9-4a35-ba4a-876ea4335e9e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:42:30.910225 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-4dd70858-7f45-492e-a913-9802bc90c85b tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] Calling method '.version_select at 0x7ff50f4d2dc0>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:30.939419 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-4dd70858-7f45-492e-a913-9802bc90c85b tempest-TestShelveInstance-324147949 tempest-TestShelveInstance-324147949-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1407100669" status: 202 len: 0 microversion: 2.1 time: 0.032654 Dec 15 13:42:30.941025 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 642/1302] 10.222.0.60 () {58 vars in 1253 bytes} [Wed Dec 15 13:42:30 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1407100669 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:42:50.350795 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-414c323b-9410-4a2f-a28a-336f0d91c24b tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-636360375", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-825054983", "security_groups": [{"name": "tempest-secgroup-smoke-316724650"}], "block_device_mapping_v2": [{"uuid": "f8b50b07-fca1-4f12-9f29-01c0a1fcd1d7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "594ca57d-8cb7-438b-9dfc-7ea84a39a8ac"}]}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:42:50.469795 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.network.neutron [None req-414c323b-9410-4a2f-a28a-336f0d91c24b tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] validate_networks() for [('594ca57d-8cb7-438b-9dfc-7ea84a39a8ac', None, None, None, None, None)] {{(pid=116942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:42:51.069029 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-414c323b-9410-4a2f-a28a-336f0d91c24b tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Flavor limits 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:42:51.069455 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-414c323b-9410-4a2f-a28a-336f0d91c24b tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Image limits 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:42:51.070025 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-414c323b-9410-4a2f-a28a-336f0d91c24b tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Flavor pref 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:42:51.070435 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-414c323b-9410-4a2f-a28a-336f0d91c24b tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Image pref 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:42:51.070868 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-414c323b-9410-4a2f-a28a-336f0d91c24b tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:42:51.079349 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-414c323b-9410-4a2f-a28a-336f0d91c24b tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:51.079798 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-414c323b-9410-4a2f-a28a-336f0d91c24b tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:51.080609 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-414c323b-9410-4a2f-a28a-336f0d91c24b tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:51.081684 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-414c323b-9410-4a2f-a28a-336f0d91c24b tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:51.097960 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-414c323b-9410-4a2f-a28a-336f0d91c24b tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Getting quotas for project ff117078def64108b7829db8db9baf7f. Resources: {'cores', 'instances', 'ram'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:42:51.102313 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-414c323b-9410-4a2f-a28a-336f0d91c24b tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Getting quotas for user 484a37a0154a4f709815c5935aef8ec2 and project ff117078def64108b7829db8db9baf7f. Resources: {'cores', 'instances', 'ram'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:42:51.155393 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-414c323b-9410-4a2f-a28a-336f0d91c24b tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Going to run 1 instances... {{(pid=116942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:42:51.157548 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-414c323b-9410-4a2f-a28a-336f0d91c24b tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: 599bdb62-e437-4f3c-9799-f60f3ce5392d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f8b50b07-fca1-4f12-9f29-01c0a1fcd1d7',volume_size=None,volume_type=None)] {{(pid=116942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:42:51.274455 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-414c323b-9410-4a2f-a28a-336f0d91c24b tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.929293 Dec 15 13:42:51.275132 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 661/1303] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Dec 15 13:42:50 2021] POST /compute/v2.1/servers => generated 405 bytes in 931 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 15 13:42:51.285368 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-1bff02f2-675d-4b32-bb8d-a63e1b168982 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:51.285985 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-1bff02f2-675d-4b32-bb8d-a63e1b168982 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: 599bdb62-e437-4f3c-9799-f60f3ce5392d] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:51.339298 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-1bff02f2-675d-4b32-bb8d-a63e1b168982 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484a37a0154a4f709815c5935aef8ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff117078def64108b7829db8db9baf7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:51.346081 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-1bff02f2-675d-4b32-bb8d-a63e1b168982 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/599bdb62-e437-4f3c-9799-f60f3ce5392d" status: 200 len: 1093 microversion: 2.1 time: 0.064870 Dec 15 13:42:51.346911 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 643/1304] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:51 2021] GET /compute/v2.1/servers/599bdb62-e437-4f3c-9799-f60f3ce5392d => generated 1093 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:42:52.363230 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-4425a351-12a0-4040-abb8-7f5d0c116acc tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:52.363903 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-4425a351-12a0-4040-abb8-7f5d0c116acc tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: 599bdb62-e437-4f3c-9799-f60f3ce5392d] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:52.371140 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4425a351-12a0-4040-abb8-7f5d0c116acc tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:52.371599 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4425a351-12a0-4040-abb8-7f5d0c116acc tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:52.372402 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4425a351-12a0-4040-abb8-7f5d0c116acc tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:52.373268 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-4425a351-12a0-4040-abb8-7f5d0c116acc tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:52.433883 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-4425a351-12a0-4040-abb8-7f5d0c116acc tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484a37a0154a4f709815c5935aef8ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff117078def64108b7829db8db9baf7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:52.448002 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-4425a351-12a0-4040-abb8-7f5d0c116acc tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/599bdb62-e437-4f3c-9799-f60f3ce5392d" status: 200 len: 1209 microversion: 2.1 time: 0.087513 Dec 15 13:42:52.448987 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 662/1305] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:52 2021] GET /compute/v2.1/servers/599bdb62-e437-4f3c-9799-f60f3ce5392d => generated 1209 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:42:53.466722 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-ed4a9927-b940-4f08-86d8-cbbc25bf301e tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:53.467402 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-ed4a9927-b940-4f08-86d8-cbbc25bf301e tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: 599bdb62-e437-4f3c-9799-f60f3ce5392d] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:53.478221 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ed4a9927-b940-4f08-86d8-cbbc25bf301e tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:53.478743 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ed4a9927-b940-4f08-86d8-cbbc25bf301e tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:53.479609 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ed4a9927-b940-4f08-86d8-cbbc25bf301e tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:53.480049 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ed4a9927-b940-4f08-86d8-cbbc25bf301e tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:53.620812 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-ed4a9927-b940-4f08-86d8-cbbc25bf301e tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484a37a0154a4f709815c5935aef8ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff117078def64108b7829db8db9baf7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:53.629536 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-ed4a9927-b940-4f08-86d8-cbbc25bf301e tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/599bdb62-e437-4f3c-9799-f60f3ce5392d" status: 200 len: 1264 microversion: 2.1 time: 0.166675 Dec 15 13:42:53.630493 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 644/1306] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:53 2021] GET /compute/v2.1/servers/599bdb62-e437-4f3c-9799-f60f3ce5392d => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:42:53.635317 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-f9a0e736-378b-4226-8369-400ab5a1e7dc req-a1ccb074-4ee2-42c8-bb66-cfef2b6d3f55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "599bdb62-e437-4f3c-9799-f60f3ce5392d", "tag": "194d02f6-3e33-467c-8b0a-eda0736909c7"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:42:53.644017 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:42:53.644017 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: warnings.warn(msg) Dec 15 13:42:53.652422 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-f9a0e736-378b-4226-8369-400ab5a1e7dc req-a1ccb074-4ee2-42c8-bb66-cfef2b6d3f55 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:53.653173 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-f9a0e736-378b-4226-8369-400ab5a1e7dc req-a1ccb074-4ee2-42c8-bb66-cfef2b6d3f55 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:53.672026 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-f9a0e736-378b-4226-8369-400ab5a1e7dc req-a1ccb074-4ee2-42c8-bb66-cfef2b6d3f55 service nova] Creating event network-changed:194d02f6-3e33-467c-8b0a-eda0736909c7 for instance 599bdb62-e437-4f3c-9799-f60f3ce5392d on hv-cinder-81322 Dec 15 13:42:53.677405 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-f9a0e736-378b-4226-8369-400ab5a1e7dc req-a1ccb074-4ee2-42c8-bb66-cfef2b6d3f55 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046527 Dec 15 13:42:53.678028 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 663/1307] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:42:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:42:54.646342 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-0802defb-e5fb-4502-b99a-d0c5316f7f3d tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:54.647420 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-0802defb-e5fb-4502-b99a-d0c5316f7f3d tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: 599bdb62-e437-4f3c-9799-f60f3ce5392d] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:54.653628 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0802defb-e5fb-4502-b99a-d0c5316f7f3d tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:54.654078 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0802defb-e5fb-4502-b99a-d0c5316f7f3d tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:54.654864 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0802defb-e5fb-4502-b99a-d0c5316f7f3d tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:54.655307 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-0802defb-e5fb-4502-b99a-d0c5316f7f3d tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:54.784715 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-0802defb-e5fb-4502-b99a-d0c5316f7f3d tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484a37a0154a4f709815c5935aef8ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff117078def64108b7829db8db9baf7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:54.791873 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-0802defb-e5fb-4502-b99a-d0c5316f7f3d tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/599bdb62-e437-4f3c-9799-f60f3ce5392d" status: 200 len: 1264 microversion: 2.1 time: 0.149193 Dec 15 13:42:54.792440 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 645/1308] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:54 2021] GET /compute/v2.1/servers/599bdb62-e437-4f3c-9799-f60f3ce5392d => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:42:55.810102 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-5c1edc97-d276-4433-b440-3b78b00f6dbf tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:55.810804 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-5c1edc97-d276-4433-b440-3b78b00f6dbf tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: 599bdb62-e437-4f3c-9799-f60f3ce5392d] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:55.816773 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5c1edc97-d276-4433-b440-3b78b00f6dbf tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:55.817225 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5c1edc97-d276-4433-b440-3b78b00f6dbf tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:55.818001 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5c1edc97-d276-4433-b440-3b78b00f6dbf tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:55.818437 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5c1edc97-d276-4433-b440-3b78b00f6dbf tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:55.949345 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-5c1edc97-d276-4433-b440-3b78b00f6dbf tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484a37a0154a4f709815c5935aef8ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff117078def64108b7829db8db9baf7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:55.957069 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-5c1edc97-d276-4433-b440-3b78b00f6dbf tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/599bdb62-e437-4f3c-9799-f60f3ce5392d" status: 200 len: 1264 microversion: 2.1 time: 0.151416 Dec 15 13:42:55.957644 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 664/1309] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:55 2021] GET /compute/v2.1/servers/599bdb62-e437-4f3c-9799-f60f3ce5392d => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:42:56.977738 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-8ef1eb2e-1928-4bd9-91c5-738ba915cdad tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:56.978347 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-8ef1eb2e-1928-4bd9-91c5-738ba915cdad tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: 599bdb62-e437-4f3c-9799-f60f3ce5392d] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:56.984710 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8ef1eb2e-1928-4bd9-91c5-738ba915cdad tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:56.985157 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8ef1eb2e-1928-4bd9-91c5-738ba915cdad tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:56.985941 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8ef1eb2e-1928-4bd9-91c5-738ba915cdad tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:56.986363 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-8ef1eb2e-1928-4bd9-91c5-738ba915cdad tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:57.115458 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-8ef1eb2e-1928-4bd9-91c5-738ba915cdad tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484a37a0154a4f709815c5935aef8ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff117078def64108b7829db8db9baf7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:57.122679 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-8ef1eb2e-1928-4bd9-91c5-738ba915cdad tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/599bdb62-e437-4f3c-9799-f60f3ce5392d" status: 200 len: 1264 microversion: 2.1 time: 0.148747 Dec 15 13:42:57.123284 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 646/1310] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:56 2021] GET /compute/v2.1/servers/599bdb62-e437-4f3c-9799-f60f3ce5392d => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:42:58.141262 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-a0e03f2d-10a3-4db5-8d46-1d455e3b1da4 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:58.141904 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-a0e03f2d-10a3-4db5-8d46-1d455e3b1da4 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: 599bdb62-e437-4f3c-9799-f60f3ce5392d] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:58.148125 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a0e03f2d-10a3-4db5-8d46-1d455e3b1da4 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:58.148577 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a0e03f2d-10a3-4db5-8d46-1d455e3b1da4 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:58.149357 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a0e03f2d-10a3-4db5-8d46-1d455e3b1da4 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:58.149797 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-a0e03f2d-10a3-4db5-8d46-1d455e3b1da4 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:58.282376 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-a0e03f2d-10a3-4db5-8d46-1d455e3b1da4 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484a37a0154a4f709815c5935aef8ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff117078def64108b7829db8db9baf7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:58.293659 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-a0e03f2d-10a3-4db5-8d46-1d455e3b1da4 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/599bdb62-e437-4f3c-9799-f60f3ce5392d" status: 200 len: 1264 microversion: 2.1 time: 0.155687 Dec 15 13:42:58.294255 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 665/1311] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:58 2021] GET /compute/v2.1/servers/599bdb62-e437-4f3c-9799-f60f3ce5392d => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:42:59.311247 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-dbe3e584-280f-4cce-a2ce-5528764bf7e4 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:59.311856 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-dbe3e584-280f-4cce-a2ce-5528764bf7e4 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: 599bdb62-e437-4f3c-9799-f60f3ce5392d] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:59.318529 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-dbe3e584-280f-4cce-a2ce-5528764bf7e4 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:59.319005 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-dbe3e584-280f-4cce-a2ce-5528764bf7e4 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:59.319777 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-dbe3e584-280f-4cce-a2ce-5528764bf7e4 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:59.320242 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-dbe3e584-280f-4cce-a2ce-5528764bf7e4 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:59.451594 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-dbe3e584-280f-4cce-a2ce-5528764bf7e4 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484a37a0154a4f709815c5935aef8ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff117078def64108b7829db8db9baf7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:59.459252 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-dbe3e584-280f-4cce-a2ce-5528764bf7e4 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/599bdb62-e437-4f3c-9799-f60f3ce5392d" status: 200 len: 1264 microversion: 2.1 time: 0.151632 Dec 15 13:42:59.459814 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 647/1312] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:59 2021] GET /compute/v2.1/servers/599bdb62-e437-4f3c-9799-f60f3ce5392d => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:43:00.483346 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-5f4d9775-54f9-4f77-bba7-e8f1fa3f4c4b tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:00.483960 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-5f4d9775-54f9-4f77-bba7-e8f1fa3f4c4b tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: 599bdb62-e437-4f3c-9799-f60f3ce5392d] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:00.490539 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5f4d9775-54f9-4f77-bba7-e8f1fa3f4c4b tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:00.491110 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5f4d9775-54f9-4f77-bba7-e8f1fa3f4c4b tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:00.491905 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5f4d9775-54f9-4f77-bba7-e8f1fa3f4c4b tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:00.492374 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5f4d9775-54f9-4f77-bba7-e8f1fa3f4c4b tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:00.620734 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-5f4d9775-54f9-4f77-bba7-e8f1fa3f4c4b tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484a37a0154a4f709815c5935aef8ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff117078def64108b7829db8db9baf7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:00.627973 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-5f4d9775-54f9-4f77-bba7-e8f1fa3f4c4b tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/599bdb62-e437-4f3c-9799-f60f3ce5392d" status: 200 len: 1264 microversion: 2.1 time: 0.148277 Dec 15 13:43:00.628552 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 666/1313] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:00 2021] GET /compute/v2.1/servers/599bdb62-e437-4f3c-9799-f60f3ce5392d => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:43:01.644589 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-53454026-c5e6-43ec-a3fb-9bb4292568b9 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:01.645186 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-53454026-c5e6-43ec-a3fb-9bb4292568b9 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: 599bdb62-e437-4f3c-9799-f60f3ce5392d] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:01.651527 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-53454026-c5e6-43ec-a3fb-9bb4292568b9 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:01.651977 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-53454026-c5e6-43ec-a3fb-9bb4292568b9 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:01.652760 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-53454026-c5e6-43ec-a3fb-9bb4292568b9 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:01.653194 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-53454026-c5e6-43ec-a3fb-9bb4292568b9 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:01.786190 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-53454026-c5e6-43ec-a3fb-9bb4292568b9 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484a37a0154a4f709815c5935aef8ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff117078def64108b7829db8db9baf7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:01.793405 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-53454026-c5e6-43ec-a3fb-9bb4292568b9 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/599bdb62-e437-4f3c-9799-f60f3ce5392d" status: 200 len: 1264 microversion: 2.1 time: 0.152604 Dec 15 13:43:01.793976 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 648/1314] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:01 2021] GET /compute/v2.1/servers/599bdb62-e437-4f3c-9799-f60f3ce5392d => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:43:02.810125 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-57695b3c-2ee8-4dca-a66d-039695628b98 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:02.810669 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-57695b3c-2ee8-4dca-a66d-039695628b98 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: 599bdb62-e437-4f3c-9799-f60f3ce5392d] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:02.817635 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-57695b3c-2ee8-4dca-a66d-039695628b98 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:02.818135 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-57695b3c-2ee8-4dca-a66d-039695628b98 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:02.818964 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-57695b3c-2ee8-4dca-a66d-039695628b98 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:02.819374 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-57695b3c-2ee8-4dca-a66d-039695628b98 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:02.951609 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-57695b3c-2ee8-4dca-a66d-039695628b98 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484a37a0154a4f709815c5935aef8ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff117078def64108b7829db8db9baf7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:02.958932 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-57695b3c-2ee8-4dca-a66d-039695628b98 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/599bdb62-e437-4f3c-9799-f60f3ce5392d" status: 200 len: 1264 microversion: 2.1 time: 0.152603 Dec 15 13:43:02.959506 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 667/1315] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:02 2021] GET /compute/v2.1/servers/599bdb62-e437-4f3c-9799-f60f3ce5392d => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:43:03.975544 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-021e8203-06e1-4f0a-a915-bcc8548cb132 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:03.976162 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-021e8203-06e1-4f0a-a915-bcc8548cb132 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: 599bdb62-e437-4f3c-9799-f60f3ce5392d] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:03.982506 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-021e8203-06e1-4f0a-a915-bcc8548cb132 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:03.982986 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-021e8203-06e1-4f0a-a915-bcc8548cb132 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:03.983773 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-021e8203-06e1-4f0a-a915-bcc8548cb132 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:03.984211 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-021e8203-06e1-4f0a-a915-bcc8548cb132 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:04.122376 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-021e8203-06e1-4f0a-a915-bcc8548cb132 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484a37a0154a4f709815c5935aef8ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff117078def64108b7829db8db9baf7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:04.130500 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-021e8203-06e1-4f0a-a915-bcc8548cb132 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/599bdb62-e437-4f3c-9799-f60f3ce5392d" status: 200 len: 1264 microversion: 2.1 time: 0.158721 Dec 15 13:43:04.131091 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 649/1316] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:03 2021] GET /compute/v2.1/servers/599bdb62-e437-4f3c-9799-f60f3ce5392d => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:43:05.147857 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-64603adb-46a5-4c65-88f7-63ca361c8320 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:05.148481 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-64603adb-46a5-4c65-88f7-63ca361c8320 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: 599bdb62-e437-4f3c-9799-f60f3ce5392d] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:05.154730 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-64603adb-46a5-4c65-88f7-63ca361c8320 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:05.155210 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-64603adb-46a5-4c65-88f7-63ca361c8320 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:05.155997 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-64603adb-46a5-4c65-88f7-63ca361c8320 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:05.156433 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-64603adb-46a5-4c65-88f7-63ca361c8320 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:05.287550 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-64603adb-46a5-4c65-88f7-63ca361c8320 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484a37a0154a4f709815c5935aef8ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff117078def64108b7829db8db9baf7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:05.295246 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-64603adb-46a5-4c65-88f7-63ca361c8320 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/599bdb62-e437-4f3c-9799-f60f3ce5392d" status: 200 len: 1264 microversion: 2.1 time: 0.151644 Dec 15 13:43:05.295836 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 668/1317] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:05 2021] GET /compute/v2.1/servers/599bdb62-e437-4f3c-9799-f60f3ce5392d => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:43:06.311672 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-5d3bef26-46c4-49fd-b6c6-d4db8ee453d0 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:06.312287 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-5d3bef26-46c4-49fd-b6c6-d4db8ee453d0 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: 599bdb62-e437-4f3c-9799-f60f3ce5392d] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:06.319973 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5d3bef26-46c4-49fd-b6c6-d4db8ee453d0 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:06.320430 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5d3bef26-46c4-49fd-b6c6-d4db8ee453d0 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:06.321216 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5d3bef26-46c4-49fd-b6c6-d4db8ee453d0 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:06.321658 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5d3bef26-46c4-49fd-b6c6-d4db8ee453d0 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:06.463296 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-5d3bef26-46c4-49fd-b6c6-d4db8ee453d0 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484a37a0154a4f709815c5935aef8ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff117078def64108b7829db8db9baf7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:06.471335 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-5d3bef26-46c4-49fd-b6c6-d4db8ee453d0 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/599bdb62-e437-4f3c-9799-f60f3ce5392d" status: 200 len: 1264 microversion: 2.1 time: 0.163227 Dec 15 13:43:06.472003 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 650/1318] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:06 2021] GET /compute/v2.1/servers/599bdb62-e437-4f3c-9799-f60f3ce5392d => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:43:07.541799 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-f2f6abc6-f91a-4357-b424-1e6eeeac3197 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:07.542438 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-f2f6abc6-f91a-4357-b424-1e6eeeac3197 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: 599bdb62-e437-4f3c-9799-f60f3ce5392d] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:07.549418 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f2f6abc6-f91a-4357-b424-1e6eeeac3197 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:07.549871 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f2f6abc6-f91a-4357-b424-1e6eeeac3197 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:07.550896 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f2f6abc6-f91a-4357-b424-1e6eeeac3197 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:07.552076 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-f2f6abc6-f91a-4357-b424-1e6eeeac3197 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:07.695349 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-f2f6abc6-f91a-4357-b424-1e6eeeac3197 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484a37a0154a4f709815c5935aef8ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff117078def64108b7829db8db9baf7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:07.702784 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-f2f6abc6-f91a-4357-b424-1e6eeeac3197 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/599bdb62-e437-4f3c-9799-f60f3ce5392d" status: 200 len: 1264 microversion: 2.1 time: 0.164720 Dec 15 13:43:07.703398 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 669/1319] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:07 2021] GET /compute/v2.1/servers/599bdb62-e437-4f3c-9799-f60f3ce5392d => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:43:08.147350 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-1813f3b5-134a-45f3-b1cb-66feb3a6cc69 req-c428645b-837a-42fd-b55d-681b66ee84f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "599bdb62-e437-4f3c-9799-f60f3ce5392d", "name": "network-vif-plugged", "status": "completed", "tag": "194d02f6-3e33-467c-8b0a-eda0736909c7"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:43:08.148900 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:43:08.148900 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: warnings.warn(msg) Dec 15 13:43:08.155593 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-1813f3b5-134a-45f3-b1cb-66feb3a6cc69 req-c428645b-837a-42fd-b55d-681b66ee84f6 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:08.156034 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-1813f3b5-134a-45f3-b1cb-66feb3a6cc69 req-c428645b-837a-42fd-b55d-681b66ee84f6 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:08.168243 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-1813f3b5-134a-45f3-b1cb-66feb3a6cc69 req-c428645b-837a-42fd-b55d-681b66ee84f6 service nova] Creating event network-vif-plugged:194d02f6-3e33-467c-8b0a-eda0736909c7 for instance 599bdb62-e437-4f3c-9799-f60f3ce5392d on hv-cinder-81322 Dec 15 13:43:08.177797 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-1813f3b5-134a-45f3-b1cb-66feb3a6cc69 req-c428645b-837a-42fd-b55d-681b66ee84f6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153413 Dec 15 13:43:08.178411 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 651/1320] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:43:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:43:08.719652 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-3fd18a39-db0e-4888-9912-cd0c7bf55168 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:08.720264 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-3fd18a39-db0e-4888-9912-cd0c7bf55168 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: 599bdb62-e437-4f3c-9799-f60f3ce5392d] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:08.726442 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3fd18a39-db0e-4888-9912-cd0c7bf55168 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:08.726918 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3fd18a39-db0e-4888-9912-cd0c7bf55168 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:08.727699 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3fd18a39-db0e-4888-9912-cd0c7bf55168 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:08.728164 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3fd18a39-db0e-4888-9912-cd0c7bf55168 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:08.857943 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-3fd18a39-db0e-4888-9912-cd0c7bf55168 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484a37a0154a4f709815c5935aef8ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff117078def64108b7829db8db9baf7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:08.865574 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-3fd18a39-db0e-4888-9912-cd0c7bf55168 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/599bdb62-e437-4f3c-9799-f60f3ce5392d" status: 200 len: 1264 microversion: 2.1 time: 0.149854 Dec 15 13:43:08.866139 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 670/1321] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:08 2021] GET /compute/v2.1/servers/599bdb62-e437-4f3c-9799-f60f3ce5392d => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:43:09.884959 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-eff8e18d-316b-41d5-8057-6a68b463b11e tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:09.885659 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-eff8e18d-316b-41d5-8057-6a68b463b11e tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: 599bdb62-e437-4f3c-9799-f60f3ce5392d] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:09.892697 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-eff8e18d-316b-41d5-8057-6a68b463b11e tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:09.893148 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-eff8e18d-316b-41d5-8057-6a68b463b11e tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:09.893948 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-eff8e18d-316b-41d5-8057-6a68b463b11e tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:09.894386 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-eff8e18d-316b-41d5-8057-6a68b463b11e tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:10.030572 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-eff8e18d-316b-41d5-8057-6a68b463b11e tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484a37a0154a4f709815c5935aef8ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff117078def64108b7829db8db9baf7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:10.037892 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-eff8e18d-316b-41d5-8057-6a68b463b11e tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/599bdb62-e437-4f3c-9799-f60f3ce5392d" status: 200 len: 1452 microversion: 2.1 time: 0.157461 Dec 15 13:43:10.038455 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 652/1322] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:09 2021] GET /compute/v2.1/servers/599bdb62-e437-4f3c-9799-f60f3ce5392d => generated 1452 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:43:10.055581 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-dc837a65-c634-49d4-a2e0-94742a24eb1d tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:10.056220 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-dc837a65-c634-49d4-a2e0-94742a24eb1d tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: 599bdb62-e437-4f3c-9799-f60f3ce5392d] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:10.063097 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-dc837a65-c634-49d4-a2e0-94742a24eb1d tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:10.063557 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-dc837a65-c634-49d4-a2e0-94742a24eb1d tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:10.064349 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-dc837a65-c634-49d4-a2e0-94742a24eb1d tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:10.064786 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-dc837a65-c634-49d4-a2e0-94742a24eb1d tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:10.196194 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-dc837a65-c634-49d4-a2e0-94742a24eb1d tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484a37a0154a4f709815c5935aef8ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff117078def64108b7829db8db9baf7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:10.203560 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-dc837a65-c634-49d4-a2e0-94742a24eb1d tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/599bdb62-e437-4f3c-9799-f60f3ce5392d" status: 200 len: 1452 microversion: 2.1 time: 0.153443 Dec 15 13:43:10.204138 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 671/1323] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:10 2021] GET /compute/v2.1/servers/599bdb62-e437-4f3c-9799-f60f3ce5392d => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:43:12.062320 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-fad01eb4-c70b-4390-8f70-ad1f47d68707 req-72904b74-f05e-4fad-8745-6cc7ec0f1cd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "599bdb62-e437-4f3c-9799-f60f3ce5392d", "tag": "194d02f6-3e33-467c-8b0a-eda0736909c7"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:43:12.064262 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:43:12.064262 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: warnings.warn(msg) Dec 15 13:43:12.072122 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-fad01eb4-c70b-4390-8f70-ad1f47d68707 req-72904b74-f05e-4fad-8745-6cc7ec0f1cd3 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:12.073057 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-fad01eb4-c70b-4390-8f70-ad1f47d68707 req-72904b74-f05e-4fad-8745-6cc7ec0f1cd3 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:12.084723 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-fad01eb4-c70b-4390-8f70-ad1f47d68707 req-72904b74-f05e-4fad-8745-6cc7ec0f1cd3 service nova] Creating event network-changed:194d02f6-3e33-467c-8b0a-eda0736909c7 for instance 599bdb62-e437-4f3c-9799-f60f3ce5392d on hv-cinder-81322 Dec 15 13:43:12.089787 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-fad01eb4-c70b-4390-8f70-ad1f47d68707 req-72904b74-f05e-4fad-8745-6cc7ec0f1cd3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031141 Dec 15 13:43:12.090391 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 653/1324] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:43:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:43:32.144038 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-44863fc7-60b3-4d4a-b687-024c1ddbb37d tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-332731851", "imageRef": "cfccedbb-7169-47ec-9bae-d4829cba54e1", "flavorRef": "452"}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:43:32.193192 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.network.neutron [None req-44863fc7-60b3-4d4a-b687-024c1ddbb37d tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] validate_networks() for None {{(pid=116942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:43:32.461461 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-44863fc7-60b3-4d4a-b687-024c1ddbb37d tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Flavor limits 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:43:32.461908 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-44863fc7-60b3-4d4a-b687-024c1ddbb37d tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Image limits 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:43:32.462365 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-44863fc7-60b3-4d4a-b687-024c1ddbb37d tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Flavor pref 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:43:32.462775 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-44863fc7-60b3-4d4a-b687-024c1ddbb37d tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Image pref 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:43:32.463219 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-44863fc7-60b3-4d4a-b687-024c1ddbb37d tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:43:32.473014 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-44863fc7-60b3-4d4a-b687-024c1ddbb37d tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:32.473467 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-44863fc7-60b3-4d4a-b687-024c1ddbb37d tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:32.474284 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-44863fc7-60b3-4d4a-b687-024c1ddbb37d tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:32.474729 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-44863fc7-60b3-4d4a-b687-024c1ddbb37d tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:32.501210 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-44863fc7-60b3-4d4a-b687-024c1ddbb37d tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Getting quotas for project 37441b2835294e6bbad06c9964fc3ee3. Resources: {'cores', 'instances', 'ram'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:43:32.506967 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-44863fc7-60b3-4d4a-b687-024c1ddbb37d tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Getting quotas for user 1a53594b5fa74defbf11b50d1fd6a325 and project 37441b2835294e6bbad06c9964fc3ee3. Resources: {'cores', 'instances', 'ram'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:43:32.520926 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-44863fc7-60b3-4d4a-b687-024c1ddbb37d tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Going to run 1 instances... {{(pid=116942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:43:32.523298 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-44863fc7-60b3-4d4a-b687-024c1ddbb37d tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] [instance: ef29eda2-47f6-433f-a3d5-87c35d013a4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cfccedbb-7169-47ec-9bae-d4829cba54e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:43:32.565817 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-44863fc7-60b3-4d4a-b687-024c1ddbb37d tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.425514 Dec 15 13:43:32.566470 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 672/1325] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Dec 15 13:43:32 2021] POST /compute/v2.1/servers => generated 380 bytes in 427 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 13:43:32.577918 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-c7da8850-ab3f-431d-acd7-f8237e75c2a7 tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:32.578656 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-c7da8850-ab3f-431d-acd7-f8237e75c2a7 tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] [instance: ef29eda2-47f6-433f-a3d5-87c35d013a4a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:32.629429 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-c7da8850-ab3f-431d-acd7-f8237e75c2a7 tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a53594b5fa74defbf11b50d1fd6a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37441b2835294e6bbad06c9964fc3ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:32.636629 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-c7da8850-ab3f-431d-acd7-f8237e75c2a7 tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] 10.222.0.60 "GET /compute/v2.1/servers/ef29eda2-47f6-433f-a3d5-87c35d013a4a" status: 200 len: 1214 microversion: 2.1 time: 0.063369 Dec 15 13:43:32.637291 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 654/1326] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:32 2021] GET /compute/v2.1/servers/ef29eda2-47f6-433f-a3d5-87c35d013a4a => generated 1214 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:43:33.654256 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-d7ec836f-2028-48a1-a6c5-b92fced9be85 tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:33.655496 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-d7ec836f-2028-48a1-a6c5-b92fced9be85 tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] [instance: ef29eda2-47f6-433f-a3d5-87c35d013a4a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:33.661372 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d7ec836f-2028-48a1-a6c5-b92fced9be85 tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:33.661819 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d7ec836f-2028-48a1-a6c5-b92fced9be85 tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:33.662611 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d7ec836f-2028-48a1-a6c5-b92fced9be85 tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:33.663080 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d7ec836f-2028-48a1-a6c5-b92fced9be85 tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:33.722569 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-d7ec836f-2028-48a1-a6c5-b92fced9be85 tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a53594b5fa74defbf11b50d1fd6a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37441b2835294e6bbad06c9964fc3ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:33.729840 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-d7ec836f-2028-48a1-a6c5-b92fced9be85 tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] 10.222.0.60 "GET /compute/v2.1/servers/ef29eda2-47f6-433f-a3d5-87c35d013a4a" status: 200 len: 1272 microversion: 2.1 time: 0.079889 Dec 15 13:43:33.730410 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 673/1327] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:33 2021] GET /compute/v2.1/servers/ef29eda2-47f6-433f-a3d5-87c35d013a4a => generated 1272 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:43:34.746717 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-d04e0256-b42f-433e-9630-3c6556521b8b tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:34.747398 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-d04e0256-b42f-433e-9630-3c6556521b8b tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] [instance: ef29eda2-47f6-433f-a3d5-87c35d013a4a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:34.754567 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d04e0256-b42f-433e-9630-3c6556521b8b tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:34.755139 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d04e0256-b42f-433e-9630-3c6556521b8b tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:34.755781 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d04e0256-b42f-433e-9630-3c6556521b8b tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:34.756435 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-d04e0256-b42f-433e-9630-3c6556521b8b tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:34.889797 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-d04e0256-b42f-433e-9630-3c6556521b8b tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a53594b5fa74defbf11b50d1fd6a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37441b2835294e6bbad06c9964fc3ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:34.897707 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-d04e0256-b42f-433e-9630-3c6556521b8b tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] 10.222.0.60 "GET /compute/v2.1/servers/ef29eda2-47f6-433f-a3d5-87c35d013a4a" status: 200 len: 1314 microversion: 2.1 time: 0.154122 Dec 15 13:43:34.898292 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 655/1328] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:34 2021] GET /compute/v2.1/servers/ef29eda2-47f6-433f-a3d5-87c35d013a4a => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:43:35.217001 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-38ad481e-0f5b-4c73-b6f9-7d803c07bb85 req-99c3ad83-ab6e-4583-8f2e-8aec6994fe20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef29eda2-47f6-433f-a3d5-87c35d013a4a", "tag": "1a4d1792-0411-47d0-b738-fbf2d4fe5ade"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:43:35.219131 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:43:35.219131 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: warnings.warn(msg) Dec 15 13:43:35.244284 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-38ad481e-0f5b-4c73-b6f9-7d803c07bb85 req-99c3ad83-ab6e-4583-8f2e-8aec6994fe20 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:35.244729 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-38ad481e-0f5b-4c73-b6f9-7d803c07bb85 req-99c3ad83-ab6e-4583-8f2e-8aec6994fe20 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:35.264391 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-38ad481e-0f5b-4c73-b6f9-7d803c07bb85 req-99c3ad83-ab6e-4583-8f2e-8aec6994fe20 service nova] Creating event network-changed:1a4d1792-0411-47d0-b738-fbf2d4fe5ade for instance ef29eda2-47f6-433f-a3d5-87c35d013a4a on hv-cinder-81322 Dec 15 13:43:35.269643 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-38ad481e-0f5b-4c73-b6f9-7d803c07bb85 req-99c3ad83-ab6e-4583-8f2e-8aec6994fe20 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056082 Dec 15 13:43:35.270256 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 674/1329] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:43:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:43:35.914980 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-380cc072-eb93-4cbf-9e46-0f9b1dcfc0ca tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:35.915595 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-380cc072-eb93-4cbf-9e46-0f9b1dcfc0ca tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] [instance: ef29eda2-47f6-433f-a3d5-87c35d013a4a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:35.921751 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-380cc072-eb93-4cbf-9e46-0f9b1dcfc0ca tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:35.922200 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-380cc072-eb93-4cbf-9e46-0f9b1dcfc0ca tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:35.923021 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-380cc072-eb93-4cbf-9e46-0f9b1dcfc0ca tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:35.923456 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-380cc072-eb93-4cbf-9e46-0f9b1dcfc0ca tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:36.056180 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-380cc072-eb93-4cbf-9e46-0f9b1dcfc0ca tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a53594b5fa74defbf11b50d1fd6a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37441b2835294e6bbad06c9964fc3ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:36.063430 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-380cc072-eb93-4cbf-9e46-0f9b1dcfc0ca tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] 10.222.0.60 "GET /compute/v2.1/servers/ef29eda2-47f6-433f-a3d5-87c35d013a4a" status: 200 len: 1314 microversion: 2.1 time: 0.152756 Dec 15 13:43:36.064035 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 656/1330] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:35 2021] GET /compute/v2.1/servers/ef29eda2-47f6-433f-a3d5-87c35d013a4a => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:43:37.082414 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-999e962d-b47e-41d3-9573-1c6f8a5fcfcb tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:37.083603 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-999e962d-b47e-41d3-9573-1c6f8a5fcfcb tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] [instance: ef29eda2-47f6-433f-a3d5-87c35d013a4a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:37.089776 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-999e962d-b47e-41d3-9573-1c6f8a5fcfcb tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:37.090226 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-999e962d-b47e-41d3-9573-1c6f8a5fcfcb tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:37.091040 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-999e962d-b47e-41d3-9573-1c6f8a5fcfcb tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:37.091478 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-999e962d-b47e-41d3-9573-1c6f8a5fcfcb tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:37.217149 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-999e962d-b47e-41d3-9573-1c6f8a5fcfcb tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a53594b5fa74defbf11b50d1fd6a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37441b2835294e6bbad06c9964fc3ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:37.224600 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-999e962d-b47e-41d3-9573-1c6f8a5fcfcb tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] 10.222.0.60 "GET /compute/v2.1/servers/ef29eda2-47f6-433f-a3d5-87c35d013a4a" status: 200 len: 1314 microversion: 2.1 time: 0.148305 Dec 15 13:43:37.225172 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 675/1331] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:37 2021] GET /compute/v2.1/servers/ef29eda2-47f6-433f-a3d5-87c35d013a4a => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:43:38.241737 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-80c8b83e-9e47-47fb-a14e-b8c3457635e9 tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:38.242286 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-80c8b83e-9e47-47fb-a14e-b8c3457635e9 tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] [instance: ef29eda2-47f6-433f-a3d5-87c35d013a4a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:38.248562 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-80c8b83e-9e47-47fb-a14e-b8c3457635e9 tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:38.249015 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-80c8b83e-9e47-47fb-a14e-b8c3457635e9 tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:38.249791 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-80c8b83e-9e47-47fb-a14e-b8c3457635e9 tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:38.250228 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-80c8b83e-9e47-47fb-a14e-b8c3457635e9 tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:38.385380 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-80c8b83e-9e47-47fb-a14e-b8c3457635e9 tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a53594b5fa74defbf11b50d1fd6a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37441b2835294e6bbad06c9964fc3ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:38.392783 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-80c8b83e-9e47-47fb-a14e-b8c3457635e9 tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] 10.222.0.60 "GET /compute/v2.1/servers/ef29eda2-47f6-433f-a3d5-87c35d013a4a" status: 200 len: 1314 microversion: 2.1 time: 0.155324 Dec 15 13:43:38.393372 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 657/1332] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:38 2021] GET /compute/v2.1/servers/ef29eda2-47f6-433f-a3d5-87c35d013a4a => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:43:39.409428 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-ea1ce74b-8cf0-41b5-b952-50b040d7284d tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:39.409970 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-ea1ce74b-8cf0-41b5-b952-50b040d7284d tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] [instance: ef29eda2-47f6-433f-a3d5-87c35d013a4a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:39.416204 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ea1ce74b-8cf0-41b5-b952-50b040d7284d tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:39.416655 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ea1ce74b-8cf0-41b5-b952-50b040d7284d tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:39.417428 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ea1ce74b-8cf0-41b5-b952-50b040d7284d tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:39.417861 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-ea1ce74b-8cf0-41b5-b952-50b040d7284d tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:39.545158 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-ea1ce74b-8cf0-41b5-b952-50b040d7284d tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a53594b5fa74defbf11b50d1fd6a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37441b2835294e6bbad06c9964fc3ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:39.552281 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-ea1ce74b-8cf0-41b5-b952-50b040d7284d tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] 10.222.0.60 "GET /compute/v2.1/servers/ef29eda2-47f6-433f-a3d5-87c35d013a4a" status: 200 len: 1314 microversion: 2.1 time: 0.146621 Dec 15 13:43:39.552850 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 676/1333] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:39 2021] GET /compute/v2.1/servers/ef29eda2-47f6-433f-a3d5-87c35d013a4a => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:43:40.187637 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-ffc079b5-3132-4145-bb5f-e564095c7ce3 req-4e35663d-5128-4114-9f96-1aae947a2afb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef29eda2-47f6-433f-a3d5-87c35d013a4a", "name": "network-vif-plugged", "status": "completed", "tag": "1a4d1792-0411-47d0-b738-fbf2d4fe5ade"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:43:40.189207 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:43:40.189207 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: warnings.warn(msg) Dec 15 13:43:40.197962 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-ffc079b5-3132-4145-bb5f-e564095c7ce3 req-4e35663d-5128-4114-9f96-1aae947a2afb service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:40.198505 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-ffc079b5-3132-4145-bb5f-e564095c7ce3 req-4e35663d-5128-4114-9f96-1aae947a2afb service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:40.210259 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-ffc079b5-3132-4145-bb5f-e564095c7ce3 req-4e35663d-5128-4114-9f96-1aae947a2afb service nova] Creating event network-vif-plugged:1a4d1792-0411-47d0-b738-fbf2d4fe5ade for instance ef29eda2-47f6-433f-a3d5-87c35d013a4a on hv-cinder-81322 Dec 15 13:43:40.215221 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-ffc079b5-3132-4145-bb5f-e564095c7ce3 req-4e35663d-5128-4114-9f96-1aae947a2afb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031661 Dec 15 13:43:40.215806 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 658/1334] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:43:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:43:40.569715 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-39c93874-e719-4661-aeef-e48cfbb4e54a tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:40.570340 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-39c93874-e719-4661-aeef-e48cfbb4e54a tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] [instance: ef29eda2-47f6-433f-a3d5-87c35d013a4a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:40.576750 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-39c93874-e719-4661-aeef-e48cfbb4e54a tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:40.577203 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-39c93874-e719-4661-aeef-e48cfbb4e54a tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:40.578076 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-39c93874-e719-4661-aeef-e48cfbb4e54a tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:40.578514 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-39c93874-e719-4661-aeef-e48cfbb4e54a tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:40.711452 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-39c93874-e719-4661-aeef-e48cfbb4e54a tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a53594b5fa74defbf11b50d1fd6a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37441b2835294e6bbad06c9964fc3ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:40.718668 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-39c93874-e719-4661-aeef-e48cfbb4e54a tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] 10.222.0.60 "GET /compute/v2.1/servers/ef29eda2-47f6-433f-a3d5-87c35d013a4a" status: 200 len: 1314 microversion: 2.1 time: 0.153109 Dec 15 13:43:40.719544 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 677/1335] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:40 2021] GET /compute/v2.1/servers/ef29eda2-47f6-433f-a3d5-87c35d013a4a => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:43:41.735781 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-b4f4606d-e9dc-4766-9fe8-7fe05dd8e508 tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:41.736483 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-b4f4606d-e9dc-4766-9fe8-7fe05dd8e508 tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] [instance: ef29eda2-47f6-433f-a3d5-87c35d013a4a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:41.744415 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b4f4606d-e9dc-4766-9fe8-7fe05dd8e508 tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:41.744870 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b4f4606d-e9dc-4766-9fe8-7fe05dd8e508 tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:41.745644 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b4f4606d-e9dc-4766-9fe8-7fe05dd8e508 tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:41.746082 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-b4f4606d-e9dc-4766-9fe8-7fe05dd8e508 tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:41.879184 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-b4f4606d-e9dc-4766-9fe8-7fe05dd8e508 tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a53594b5fa74defbf11b50d1fd6a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37441b2835294e6bbad06c9964fc3ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:41.887282 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-b4f4606d-e9dc-4766-9fe8-7fe05dd8e508 tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] 10.222.0.60 "GET /compute/v2.1/servers/ef29eda2-47f6-433f-a3d5-87c35d013a4a" status: 200 len: 1463 microversion: 2.1 time: 0.155537 Dec 15 13:43:41.887861 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 659/1336] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:41 2021] GET /compute/v2.1/servers/ef29eda2-47f6-433f-a3d5-87c35d013a4a => generated 1463 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:43:41.923223 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-dec550d5-7882-4baf-bb3d-529180258b0e tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:41.923776 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-dec550d5-7882-4baf-bb3d-529180258b0e tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] [instance: ef29eda2-47f6-433f-a3d5-87c35d013a4a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:41.929962 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-dec550d5-7882-4baf-bb3d-529180258b0e tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:41.930423 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-dec550d5-7882-4baf-bb3d-529180258b0e tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:41.931230 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-dec550d5-7882-4baf-bb3d-529180258b0e tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:41.931672 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-dec550d5-7882-4baf-bb3d-529180258b0e tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:41.955500 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-dec550d5-7882-4baf-bb3d-529180258b0e tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] [instance: ef29eda2-47f6-433f-a3d5-87c35d013a4a] Going to try to terminate instance {{(pid=116942) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:43:42.032648 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-dec550d5-7882-4baf-bb3d-529180258b0e tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ef29eda2-47f6-433f-a3d5-87c35d013a4a" status: 204 len: 0 microversion: 2.1 time: 0.112767 Dec 15 13:43:42.033707 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 678/1337] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Dec 15 13:43:41 2021] DELETE /compute/v2.1/servers/ef29eda2-47f6-433f-a3d5-87c35d013a4a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:43:42.042540 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-381c2536-7638-43a5-96ee-c03a914bb903 tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:42.043189 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-381c2536-7638-43a5-96ee-c03a914bb903 tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] [instance: ef29eda2-47f6-433f-a3d5-87c35d013a4a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:42.048925 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-381c2536-7638-43a5-96ee-c03a914bb903 tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:42.049374 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-381c2536-7638-43a5-96ee-c03a914bb903 tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:42.050176 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-381c2536-7638-43a5-96ee-c03a914bb903 tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:42.050609 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-381c2536-7638-43a5-96ee-c03a914bb903 tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:42.176471 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-381c2536-7638-43a5-96ee-c03a914bb903 tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a53594b5fa74defbf11b50d1fd6a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37441b2835294e6bbad06c9964fc3ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:42.184248 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-381c2536-7638-43a5-96ee-c03a914bb903 tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] 10.222.0.60 "GET /compute/v2.1/servers/ef29eda2-47f6-433f-a3d5-87c35d013a4a" status: 200 len: 1469 microversion: 2.1 time: 0.145342 Dec 15 13:43:42.184815 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 660/1338] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:42 2021] GET /compute/v2.1/servers/ef29eda2-47f6-433f-a3d5-87c35d013a4a => generated 1469 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:43:43.201539 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-3687adae-cd9e-4bde-9c38-5a9248ff4de2 tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:43.202236 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-3687adae-cd9e-4bde-9c38-5a9248ff4de2 tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] [instance: ef29eda2-47f6-433f-a3d5-87c35d013a4a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:43.208454 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3687adae-cd9e-4bde-9c38-5a9248ff4de2 tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:43.209150 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3687adae-cd9e-4bde-9c38-5a9248ff4de2 tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:43.209673 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3687adae-cd9e-4bde-9c38-5a9248ff4de2 tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:43.210113 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-3687adae-cd9e-4bde-9c38-5a9248ff4de2 tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:43.342330 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-3687adae-cd9e-4bde-9c38-5a9248ff4de2 tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a53594b5fa74defbf11b50d1fd6a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37441b2835294e6bbad06c9964fc3ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:43.350048 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-3687adae-cd9e-4bde-9c38-5a9248ff4de2 tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] 10.222.0.60 "GET /compute/v2.1/servers/ef29eda2-47f6-433f-a3d5-87c35d013a4a" status: 200 len: 1469 microversion: 2.1 time: 0.152543 Dec 15 13:43:43.350651 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 679/1339] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:43 2021] GET /compute/v2.1/servers/ef29eda2-47f6-433f-a3d5-87c35d013a4a => generated 1469 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:43:44.067755 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-ec47b544-2cee-4362-b21f-02dde62485d0 req-ceb9638a-9abe-4be4-a213-fa24c2b3be74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef29eda2-47f6-433f-a3d5-87c35d013a4a", "name": "network-vif-deleted", "tag": "1a4d1792-0411-47d0-b738-fbf2d4fe5ade"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:43:44.069311 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:43:44.069311 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: warnings.warn(msg) Dec 15 13:43:44.081758 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-ec47b544-2cee-4362-b21f-02dde62485d0 req-ceb9638a-9abe-4be4-a213-fa24c2b3be74 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:44.082229 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-ec47b544-2cee-4362-b21f-02dde62485d0 req-ceb9638a-9abe-4be4-a213-fa24c2b3be74 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:44.094685 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-ec47b544-2cee-4362-b21f-02dde62485d0 req-ceb9638a-9abe-4be4-a213-fa24c2b3be74 service nova] Creating event network-vif-deleted:1a4d1792-0411-47d0-b738-fbf2d4fe5ade for instance ef29eda2-47f6-433f-a3d5-87c35d013a4a on hv-cinder-81322 Dec 15 13:43:44.099557 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-ec47b544-2cee-4362-b21f-02dde62485d0 req-ceb9638a-9abe-4be4-a213-fa24c2b3be74 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035488 Dec 15 13:43:44.100172 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 661/1340] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:43:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:43:44.368274 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-716e3663-9c6f-4075-b736-b61c766c2a56 tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:44.368802 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-716e3663-9c6f-4075-b736-b61c766c2a56 tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] [instance: ef29eda2-47f6-433f-a3d5-87c35d013a4a] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:44.374949 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-716e3663-9c6f-4075-b736-b61c766c2a56 tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:44.375400 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-716e3663-9c6f-4075-b736-b61c766c2a56 tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:44.376169 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-716e3663-9c6f-4075-b736-b61c766c2a56 tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:44.376609 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-716e3663-9c6f-4075-b736-b61c766c2a56 tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:44.415887 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-716e3663-9c6f-4075-b736-b61c766c2a56 tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:44.416331 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-716e3663-9c6f-4075-b736-b61c766c2a56 tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:44.416776 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.objects.instance [None req-716e3663-9c6f-4075-b736-b61c766c2a56 tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Lazy-loading 'fault' on Instance uuid ef29eda2-47f6-433f-a3d5-87c35d013a4a {{(pid=116942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:43:44.456073 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-716e3663-9c6f-4075-b736-b61c766c2a56 tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a53594b5fa74defbf11b50d1fd6a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37441b2835294e6bbad06c9964fc3ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:44.463953 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-716e3663-9c6f-4075-b736-b61c766c2a56 tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] 10.222.0.60 "GET /compute/v2.1/servers/ef29eda2-47f6-433f-a3d5-87c35d013a4a" status: 200 len: 1304 microversion: 2.1 time: 0.099499 Dec 15 13:43:44.464542 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 680/1341] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:44 2021] GET /compute/v2.1/servers/ef29eda2-47f6-433f-a3d5-87c35d013a4a => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:43:45.482650 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-1b51c456-c9df-4017-a16d-5ca3ec21df23 tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:45.483373 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-1b51c456-c9df-4017-a16d-5ca3ec21df23 tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] [instance: ef29eda2-47f6-433f-a3d5-87c35d013a4a] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:45.489538 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1b51c456-c9df-4017-a16d-5ca3ec21df23 tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:45.489989 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1b51c456-c9df-4017-a16d-5ca3ec21df23 tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:45.490770 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1b51c456-c9df-4017-a16d-5ca3ec21df23 tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:45.491242 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1b51c456-c9df-4017-a16d-5ca3ec21df23 tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:45.504043 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.wsgi [None req-1b51c456-c9df-4017-a16d-5ca3ec21df23 tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] HTTP exception thrown: Instance ef29eda2-47f6-433f-a3d5-87c35d013a4a could not be found. Dec 15 13:43:45.504628 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-1b51c456-c9df-4017-a16d-5ca3ec21df23 tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] Returning 404 to user: Instance ef29eda2-47f6-433f-a3d5-87c35d013a4a could not be found. {{(pid=116941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:43:45.505471 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-1b51c456-c9df-4017-a16d-5ca3ec21df23 tempest-VolumesNegativeTest-1388308660 tempest-VolumesNegativeTest-1388308660-project] 10.222.0.60 "GET /compute/v2.1/servers/ef29eda2-47f6-433f-a3d5-87c35d013a4a" status: 404 len: 111 microversion: 2.1 time: 0.027378 Dec 15 13:43:45.506002 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 662/1342] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:45 2021] GET /compute/v2.1/servers/ef29eda2-47f6-433f-a3d5-87c35d013a4a => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:45:48.605283 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: ERROR oslo.messaging._drivers.impl_rabbit [-] [12c04aca-e0de-4513-9e04-80226c05c50d] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 15 13:45:48.609050 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-35110b4c-728c-4292-b155-e50eb1ec6eea tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:45:48.609547 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-35110b4c-728c-4292-b155-e50eb1ec6eea tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: 599bdb62-e437-4f3c-9799-f60f3ce5392d] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:45:48.615401 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-35110b4c-728c-4292-b155-e50eb1ec6eea tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:48.615850 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-35110b4c-728c-4292-b155-e50eb1ec6eea tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:48.616658 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-35110b4c-728c-4292-b155-e50eb1ec6eea tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:48.617098 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-35110b4c-728c-4292-b155-e50eb1ec6eea tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:48.640914 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-35110b4c-728c-4292-b155-e50eb1ec6eea tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: 599bdb62-e437-4f3c-9799-f60f3ce5392d] Going to try to terminate instance {{(pid=116942) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:45:48.712176 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-35110b4c-728c-4292-b155-e50eb1ec6eea tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "DELETE /compute/v2.1/servers/599bdb62-e437-4f3c-9799-f60f3ce5392d" status: 204 len: 0 microversion: 2.1 time: 0.108997 Dec 15 13:45:48.712772 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 681/1343] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Dec 15 13:45:48 2021] DELETE /compute/v2.1/servers/599bdb62-e437-4f3c-9799-f60f3ce5392d => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:45:48.720095 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9ec0e50f-cbc7-434f-bbd3-e475e0769c3a] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 15 13:45:48.724389 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-de7c9354-e6b8-4c3b-8e19-c399adbe6ba5 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:45:48.724997 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-de7c9354-e6b8-4c3b-8e19-c399adbe6ba5 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: 599bdb62-e437-4f3c-9799-f60f3ce5392d] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:45:48.731071 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-de7c9354-e6b8-4c3b-8e19-c399adbe6ba5 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:48.731515 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-de7c9354-e6b8-4c3b-8e19-c399adbe6ba5 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:48.732284 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-de7c9354-e6b8-4c3b-8e19-c399adbe6ba5 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:48.732716 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-de7c9354-e6b8-4c3b-8e19-c399adbe6ba5 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:48.865770 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-de7c9354-e6b8-4c3b-8e19-c399adbe6ba5 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484a37a0154a4f709815c5935aef8ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff117078def64108b7829db8db9baf7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:45:48.873195 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-de7c9354-e6b8-4c3b-8e19-c399adbe6ba5 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/599bdb62-e437-4f3c-9799-f60f3ce5392d" status: 200 len: 1576 microversion: 2.1 time: 0.156121 Dec 15 13:45:48.873761 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 663/1344] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:45:48 2021] GET /compute/v2.1/servers/599bdb62-e437-4f3c-9799-f60f3ce5392d => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:45:49.889822 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-bedf38fa-179e-4266-9755-6b842e0b2f74 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:45:49.890544 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-bedf38fa-179e-4266-9755-6b842e0b2f74 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: 599bdb62-e437-4f3c-9799-f60f3ce5392d] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:45:49.910806 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-bedf38fa-179e-4266-9755-6b842e0b2f74 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:49.911294 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-bedf38fa-179e-4266-9755-6b842e0b2f74 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:49.912231 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-bedf38fa-179e-4266-9755-6b842e0b2f74 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:49.912705 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-bedf38fa-179e-4266-9755-6b842e0b2f74 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:49.916143 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO oslo.messaging._drivers.impl_rabbit [-] [12c04aca-e0de-4513-9e04-80226c05c50d] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 50828. Dec 15 13:45:50.042696 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-bedf38fa-179e-4266-9755-6b842e0b2f74 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484a37a0154a4f709815c5935aef8ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff117078def64108b7829db8db9baf7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:45:50.050503 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-bedf38fa-179e-4266-9755-6b842e0b2f74 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/599bdb62-e437-4f3c-9799-f60f3ce5392d" status: 200 len: 1576 microversion: 2.1 time: 0.164746 Dec 15 13:45:50.051109 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 682/1345] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:45:49 2021] GET /compute/v2.1/servers/599bdb62-e437-4f3c-9799-f60f3ce5392d => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:45:51.067984 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-f72f0c9e-7d55-4b16-a747-db06fa657947 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:45:51.068610 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-f72f0c9e-7d55-4b16-a747-db06fa657947 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: 599bdb62-e437-4f3c-9799-f60f3ce5392d] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:45:51.085237 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f72f0c9e-7d55-4b16-a747-db06fa657947 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:51.085622 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f72f0c9e-7d55-4b16-a747-db06fa657947 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:51.086430 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f72f0c9e-7d55-4b16-a747-db06fa657947 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:51.086899 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f72f0c9e-7d55-4b16-a747-db06fa657947 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:51.102386 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO oslo.messaging._drivers.impl_rabbit [-] [9ec0e50f-cbc7-434f-bbd3-e475e0769c3a] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 50832. Dec 15 13:45:51.151328 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-f72f0c9e-7d55-4b16-a747-db06fa657947 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484a37a0154a4f709815c5935aef8ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff117078def64108b7829db8db9baf7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:45:51.158660 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-f72f0c9e-7d55-4b16-a747-db06fa657947 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/599bdb62-e437-4f3c-9799-f60f3ce5392d" status: 200 len: 1509 microversion: 2.1 time: 0.094385 Dec 15 13:45:51.159265 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 664/1346] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:45:51 2021] GET /compute/v2.1/servers/599bdb62-e437-4f3c-9799-f60f3ce5392d => generated 1509 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:45:51.277584 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-08492cd6-acca-47a4-b846-eb18d67fb6bb req-14dabf6d-0e7f-4274-83a0-9896b8f3d942 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "599bdb62-e437-4f3c-9799-f60f3ce5392d", "name": "network-vif-deleted", "tag": "194d02f6-3e33-467c-8b0a-eda0736909c7"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:45:51.279907 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:45:51.279907 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: warnings.warn(msg) Dec 15 13:45:51.289894 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-08492cd6-acca-47a4-b846-eb18d67fb6bb req-14dabf6d-0e7f-4274-83a0-9896b8f3d942 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:51.290876 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-08492cd6-acca-47a4-b846-eb18d67fb6bb req-14dabf6d-0e7f-4274-83a0-9896b8f3d942 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:51.307938 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-08492cd6-acca-47a4-b846-eb18d67fb6bb req-14dabf6d-0e7f-4274-83a0-9896b8f3d942 service nova] Creating event network-vif-deleted:194d02f6-3e33-467c-8b0a-eda0736909c7 for instance 599bdb62-e437-4f3c-9799-f60f3ce5392d on hv-cinder-81322 Dec 15 13:45:51.315724 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-08492cd6-acca-47a4-b846-eb18d67fb6bb req-14dabf6d-0e7f-4274-83a0-9896b8f3d942 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042365 Dec 15 13:45:51.317047 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 683/1347] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:45:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:45:52.175666 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-83629d2a-f6b6-452e-ba50-25e5fac95635 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:45:52.176368 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-83629d2a-f6b6-452e-ba50-25e5fac95635 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: 599bdb62-e437-4f3c-9799-f60f3ce5392d] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:45:52.182759 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-83629d2a-f6b6-452e-ba50-25e5fac95635 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:52.183316 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-83629d2a-f6b6-452e-ba50-25e5fac95635 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:52.184181 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-83629d2a-f6b6-452e-ba50-25e5fac95635 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:52.184717 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-83629d2a-f6b6-452e-ba50-25e5fac95635 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:52.198111 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.wsgi [None req-83629d2a-f6b6-452e-ba50-25e5fac95635 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] HTTP exception thrown: Instance 599bdb62-e437-4f3c-9799-f60f3ce5392d could not be found. Dec 15 13:45:52.198737 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-83629d2a-f6b6-452e-ba50-25e5fac95635 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Returning 404 to user: Instance 599bdb62-e437-4f3c-9799-f60f3ce5392d could not be found. {{(pid=116941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:45:52.199601 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-83629d2a-f6b6-452e-ba50-25e5fac95635 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/599bdb62-e437-4f3c-9799-f60f3ce5392d" status: 404 len: 111 microversion: 2.1 time: 0.027699 Dec 15 13:45:52.200145 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 665/1348] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:45:52 2021] GET /compute/v2.1/servers/599bdb62-e437-4f3c-9799-f60f3ce5392d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:45:52.296610 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-bb9bf653-917e-41a6-b81f-38d82facd4c7 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1059350664", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-825054983", "security_groups": [{"name": "tempest-secgroup-smoke-316724650"}], "block_device_mapping_v2": [{"uuid": "f8b50b07-fca1-4f12-9f29-01c0a1fcd1d7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "594ca57d-8cb7-438b-9dfc-7ea84a39a8ac"}]}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:45:52.404942 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.network.neutron [None req-bb9bf653-917e-41a6-b81f-38d82facd4c7 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] validate_networks() for [('594ca57d-8cb7-438b-9dfc-7ea84a39a8ac', None, None, None, None, None)] {{(pid=116942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:45:52.849649 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-bb9bf653-917e-41a6-b81f-38d82facd4c7 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Flavor limits 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:45:52.850068 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-bb9bf653-917e-41a6-b81f-38d82facd4c7 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Image limits 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:45:52.850533 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-bb9bf653-917e-41a6-b81f-38d82facd4c7 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Flavor pref 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:45:52.850978 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-bb9bf653-917e-41a6-b81f-38d82facd4c7 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Image pref 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:45:52.851387 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-bb9bf653-917e-41a6-b81f-38d82facd4c7 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:45:52.860665 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-bb9bf653-917e-41a6-b81f-38d82facd4c7 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:52.861113 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-bb9bf653-917e-41a6-b81f-38d82facd4c7 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:52.861923 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-bb9bf653-917e-41a6-b81f-38d82facd4c7 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:52.862359 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-bb9bf653-917e-41a6-b81f-38d82facd4c7 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:52.877828 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-bb9bf653-917e-41a6-b81f-38d82facd4c7 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Getting quotas for project ff117078def64108b7829db8db9baf7f. Resources: {'cores', 'instances', 'ram'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:45:52.881635 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-bb9bf653-917e-41a6-b81f-38d82facd4c7 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Getting quotas for user 484a37a0154a4f709815c5935aef8ec2 and project ff117078def64108b7829db8db9baf7f. Resources: {'cores', 'instances', 'ram'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:45:52.935467 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-bb9bf653-917e-41a6-b81f-38d82facd4c7 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Going to run 1 instances... {{(pid=116942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:45:52.937743 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-bb9bf653-917e-41a6-b81f-38d82facd4c7 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: 6266e4c0-1dd9-4859-ae9c-ae17bbacae4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f8b50b07-fca1-4f12-9f29-01c0a1fcd1d7',volume_size=None,volume_type=None)] {{(pid=116942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:45:53.053680 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: ERROR oslo.messaging._drivers.impl_rabbit [None req-bb9bf653-917e-41a6-b81f-38d82facd4c7 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [efcd60fb-9cb9-405d-ba97-c460f7bd320b] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 15 13:45:54.070926 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO oslo.messaging._drivers.impl_rabbit [None req-bb9bf653-917e-41a6-b81f-38d82facd4c7 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [efcd60fb-9cb9-405d-ba97-c460f7bd320b] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 50858. Dec 15 13:45:54.075264 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-bb9bf653-917e-41a6-b81f-38d82facd4c7 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.783449 Dec 15 13:45:54.075924 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 684/1349] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Dec 15 13:45:52 2021] POST /compute/v2.1/servers => generated 405 bytes in 1785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 15 13:45:54.085716 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-8763d4c8-cd2a-4498-9c01-bcc9f3e4ae41 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:45:54.086335 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-8763d4c8-cd2a-4498-9c01-bcc9f3e4ae41 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: 6266e4c0-1dd9-4859-ae9c-ae17bbacae4b] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:45:54.137249 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-8763d4c8-cd2a-4498-9c01-bcc9f3e4ae41 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484a37a0154a4f709815c5935aef8ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff117078def64108b7829db8db9baf7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:45:54.143764 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-8763d4c8-cd2a-4498-9c01-bcc9f3e4ae41 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/6266e4c0-1dd9-4859-ae9c-ae17bbacae4b" status: 200 len: 1094 microversion: 2.1 time: 0.061791 Dec 15 13:45:54.144332 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 666/1350] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:45:54 2021] GET /compute/v2.1/servers/6266e4c0-1dd9-4859-ae9c-ae17bbacae4b => generated 1094 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:45:55.161120 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-0e1cd14c-7c36-4bb7-ad45-a2f8f61f1ec7 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:45:55.161740 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-0e1cd14c-7c36-4bb7-ad45-a2f8f61f1ec7 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: 6266e4c0-1dd9-4859-ae9c-ae17bbacae4b] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:45:55.212325 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-0e1cd14c-7c36-4bb7-ad45-a2f8f61f1ec7 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484a37a0154a4f709815c5935aef8ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff117078def64108b7829db8db9baf7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:45:55.219265 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-0e1cd14c-7c36-4bb7-ad45-a2f8f61f1ec7 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/6266e4c0-1dd9-4859-ae9c-ae17bbacae4b" status: 200 len: 1094 microversion: 2.1 time: 0.062277 Dec 15 13:45:55.219835 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 685/1351] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:45:55 2021] GET /compute/v2.1/servers/6266e4c0-1dd9-4859-ae9c-ae17bbacae4b => generated 1094 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:45:56.235825 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-21198e61-fbef-4962-ab6e-bc204d26d8fc tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:45:56.236448 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-21198e61-fbef-4962-ab6e-bc204d26d8fc tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: 6266e4c0-1dd9-4859-ae9c-ae17bbacae4b] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:45:56.289342 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-21198e61-fbef-4962-ab6e-bc204d26d8fc tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484a37a0154a4f709815c5935aef8ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff117078def64108b7829db8db9baf7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:45:56.296361 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-21198e61-fbef-4962-ab6e-bc204d26d8fc tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/6266e4c0-1dd9-4859-ae9c-ae17bbacae4b" status: 200 len: 1094 microversion: 2.1 time: 0.064217 Dec 15 13:45:56.296946 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 667/1352] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:45:56 2021] GET /compute/v2.1/servers/6266e4c0-1dd9-4859-ae9c-ae17bbacae4b => generated 1094 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:45:57.312560 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-46f86c83-182f-4ae8-8b8e-07dcab73b94c tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:45:57.313175 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-46f86c83-182f-4ae8-8b8e-07dcab73b94c tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: 6266e4c0-1dd9-4859-ae9c-ae17bbacae4b] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:45:57.363901 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-46f86c83-182f-4ae8-8b8e-07dcab73b94c tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484a37a0154a4f709815c5935aef8ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff117078def64108b7829db8db9baf7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:45:57.370766 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-46f86c83-182f-4ae8-8b8e-07dcab73b94c tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/6266e4c0-1dd9-4859-ae9c-ae17bbacae4b" status: 200 len: 1094 microversion: 2.1 time: 0.061830 Dec 15 13:45:57.371385 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 686/1353] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:45:57 2021] GET /compute/v2.1/servers/6266e4c0-1dd9-4859-ae9c-ae17bbacae4b => generated 1094 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:45:58.387194 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-480885ba-4c80-4974-a80a-9f5d0aeaf529 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:45:58.387781 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-480885ba-4c80-4974-a80a-9f5d0aeaf529 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: 6266e4c0-1dd9-4859-ae9c-ae17bbacae4b] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:45:58.393983 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-480885ba-4c80-4974-a80a-9f5d0aeaf529 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:58.394430 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-480885ba-4c80-4974-a80a-9f5d0aeaf529 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:58.395228 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-480885ba-4c80-4974-a80a-9f5d0aeaf529 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:58.395666 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-480885ba-4c80-4974-a80a-9f5d0aeaf529 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:58.451823 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-480885ba-4c80-4974-a80a-9f5d0aeaf529 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484a37a0154a4f709815c5935aef8ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff117078def64108b7829db8db9baf7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:45:58.459020 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-480885ba-4c80-4974-a80a-9f5d0aeaf529 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/6266e4c0-1dd9-4859-ae9c-ae17bbacae4b" status: 200 len: 1144 microversion: 2.1 time: 0.075445 Dec 15 13:45:58.459787 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 668/1354] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:45:58 2021] GET /compute/v2.1/servers/6266e4c0-1dd9-4859-ae9c-ae17bbacae4b => generated 1144 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:45:59.476081 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-40939a37-5c36-4efe-8b52-3047a04f94d3 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:45:59.477567 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-40939a37-5c36-4efe-8b52-3047a04f94d3 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: 6266e4c0-1dd9-4859-ae9c-ae17bbacae4b] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:45:59.485417 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-40939a37-5c36-4efe-8b52-3047a04f94d3 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:59.485879 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-40939a37-5c36-4efe-8b52-3047a04f94d3 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:59.486680 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-40939a37-5c36-4efe-8b52-3047a04f94d3 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:59.487338 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-40939a37-5c36-4efe-8b52-3047a04f94d3 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:59.818219 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-40939a37-5c36-4efe-8b52-3047a04f94d3 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484a37a0154a4f709815c5935aef8ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff117078def64108b7829db8db9baf7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:45:59.826389 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-40939a37-5c36-4efe-8b52-3047a04f94d3 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/6266e4c0-1dd9-4859-ae9c-ae17bbacae4b" status: 200 len: 1277 microversion: 2.1 time: 0.354101 Dec 15 13:45:59.837691 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 687/1355] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:45:59 2021] GET /compute/v2.1/servers/6266e4c0-1dd9-4859-ae9c-ae17bbacae4b => generated 1277 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:46:00.351127 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-68956ca4-a39d-4123-9a22-d79d4f018261 req-6acc2cf6-bcd4-4b47-8721-c18442a80c9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6266e4c0-1dd9-4859-ae9c-ae17bbacae4b", "tag": "e3401a55-6804-4ee1-aba8-8e5fd04ec241"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:46:00.353284 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:46:00.353284 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: warnings.warn(msg) Dec 15 13:46:00.363038 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-68956ca4-a39d-4123-9a22-d79d4f018261 req-6acc2cf6-bcd4-4b47-8721-c18442a80c9e service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:46:00.363752 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-68956ca4-a39d-4123-9a22-d79d4f018261 req-6acc2cf6-bcd4-4b47-8721-c18442a80c9e service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:46:00.376703 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-68956ca4-a39d-4123-9a22-d79d4f018261 req-6acc2cf6-bcd4-4b47-8721-c18442a80c9e service nova] Creating event network-changed:e3401a55-6804-4ee1-aba8-8e5fd04ec241 for instance 6266e4c0-1dd9-4859-ae9c-ae17bbacae4b on hv-cinder-81322 Dec 15 13:46:00.381651 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-68956ca4-a39d-4123-9a22-d79d4f018261 req-6acc2cf6-bcd4-4b47-8721-c18442a80c9e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034083 Dec 15 13:46:00.386118 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 669/1356] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:46:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:46:00.846210 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-40b9c8dd-c9e4-43cc-9f87-80690d548985 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:46:00.846814 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-40b9c8dd-c9e4-43cc-9f87-80690d548985 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: 6266e4c0-1dd9-4859-ae9c-ae17bbacae4b] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:46:00.853326 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-40b9c8dd-c9e4-43cc-9f87-80690d548985 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:46:00.853771 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-40b9c8dd-c9e4-43cc-9f87-80690d548985 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:46:00.854580 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-40b9c8dd-c9e4-43cc-9f87-80690d548985 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:46:00.855328 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-40b9c8dd-c9e4-43cc-9f87-80690d548985 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:46:00.961185 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:46:00.961513 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: Wed Dec 15 13:46:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 13:46:00.993524 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-40b9c8dd-c9e4-43cc-9f87-80690d548985 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484a37a0154a4f709815c5935aef8ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff117078def64108b7829db8db9baf7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:46:01.001874 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-40b9c8dd-c9e4-43cc-9f87-80690d548985 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/6266e4c0-1dd9-4859-ae9c-ae17bbacae4b" status: 200 len: 1265 microversion: 2.1 time: 0.159998 Dec 15 13:46:01.002472 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 688/1357] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:46:00 2021] GET /compute/v2.1/servers/6266e4c0-1dd9-4859-ae9c-ae17bbacae4b => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:46:02.019821 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-a0280254-24cc-48ee-8a86-9ce7672c8ef0 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:46:02.020524 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-a0280254-24cc-48ee-8a86-9ce7672c8ef0 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: 6266e4c0-1dd9-4859-ae9c-ae17bbacae4b] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:46:02.026580 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a0280254-24cc-48ee-8a86-9ce7672c8ef0 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:46:02.027132 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a0280254-24cc-48ee-8a86-9ce7672c8ef0 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:46:02.027912 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a0280254-24cc-48ee-8a86-9ce7672c8ef0 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:46:02.028349 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a0280254-24cc-48ee-8a86-9ce7672c8ef0 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:46:02.168398 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-a0280254-24cc-48ee-8a86-9ce7672c8ef0 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484a37a0154a4f709815c5935aef8ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff117078def64108b7829db8db9baf7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:46:02.175733 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-a0280254-24cc-48ee-8a86-9ce7672c8ef0 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/6266e4c0-1dd9-4859-ae9c-ae17bbacae4b" status: 200 len: 1265 microversion: 2.1 time: 0.160285 Dec 15 13:46:02.176248 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 670/1358] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:46:02 2021] GET /compute/v2.1/servers/6266e4c0-1dd9-4859-ae9c-ae17bbacae4b => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:46:03.192837 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-06622b18-2f5b-404b-b4a8-f3cf80d38648 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:46:03.193359 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-06622b18-2f5b-404b-b4a8-f3cf80d38648 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: 6266e4c0-1dd9-4859-ae9c-ae17bbacae4b] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:46:03.199663 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-06622b18-2f5b-404b-b4a8-f3cf80d38648 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:46:03.200124 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-06622b18-2f5b-404b-b4a8-f3cf80d38648 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:46:03.200901 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-06622b18-2f5b-404b-b4a8-f3cf80d38648 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:46:03.201339 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-06622b18-2f5b-404b-b4a8-f3cf80d38648 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:46:03.330113 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-06622b18-2f5b-404b-b4a8-f3cf80d38648 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484a37a0154a4f709815c5935aef8ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff117078def64108b7829db8db9baf7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:46:03.337305 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-06622b18-2f5b-404b-b4a8-f3cf80d38648 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/6266e4c0-1dd9-4859-ae9c-ae17bbacae4b" status: 200 len: 1265 microversion: 2.1 time: 0.148196 Dec 15 13:46:03.337878 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 689/1359] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:46:03 2021] GET /compute/v2.1/servers/6266e4c0-1dd9-4859-ae9c-ae17bbacae4b => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:46:04.354026 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-e7bb8289-8b06-49c1-8991-2eb5516e1e1a tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:46:04.354649 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-e7bb8289-8b06-49c1-8991-2eb5516e1e1a tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: 6266e4c0-1dd9-4859-ae9c-ae17bbacae4b] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:46:04.361785 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e7bb8289-8b06-49c1-8991-2eb5516e1e1a tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:46:04.362247 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e7bb8289-8b06-49c1-8991-2eb5516e1e1a tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:46:04.363082 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e7bb8289-8b06-49c1-8991-2eb5516e1e1a tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:46:04.363529 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-e7bb8289-8b06-49c1-8991-2eb5516e1e1a tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:46:04.503551 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-e7bb8289-8b06-49c1-8991-2eb5516e1e1a tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484a37a0154a4f709815c5935aef8ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff117078def64108b7829db8db9baf7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:46:04.510752 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-e7bb8289-8b06-49c1-8991-2eb5516e1e1a tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/6266e4c0-1dd9-4859-ae9c-ae17bbacae4b" status: 200 len: 1265 microversion: 2.1 time: 0.160403 Dec 15 13:46:04.511354 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 671/1360] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:46:04 2021] GET /compute/v2.1/servers/6266e4c0-1dd9-4859-ae9c-ae17bbacae4b => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:46:05.526425 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-e05a0c80-8a62-486c-acb6-6fc58db7b0c9 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:46:05.527079 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-e05a0c80-8a62-486c-acb6-6fc58db7b0c9 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: 6266e4c0-1dd9-4859-ae9c-ae17bbacae4b] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:46:05.533322 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e05a0c80-8a62-486c-acb6-6fc58db7b0c9 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:46:05.533711 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e05a0c80-8a62-486c-acb6-6fc58db7b0c9 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:46:05.534490 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e05a0c80-8a62-486c-acb6-6fc58db7b0c9 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:46:05.534949 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-e05a0c80-8a62-486c-acb6-6fc58db7b0c9 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:46:05.662209 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-e05a0c80-8a62-486c-acb6-6fc58db7b0c9 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484a37a0154a4f709815c5935aef8ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff117078def64108b7829db8db9baf7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:46:05.669548 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-e05a0c80-8a62-486c-acb6-6fc58db7b0c9 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/6266e4c0-1dd9-4859-ae9c-ae17bbacae4b" status: 200 len: 1265 microversion: 2.1 time: 0.146792 Dec 15 13:46:05.670124 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 690/1361] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:46:05 2021] GET /compute/v2.1/servers/6266e4c0-1dd9-4859-ae9c-ae17bbacae4b => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:46:06.686121 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-5d6d427f-b2ec-40e1-b32a-32ca7d83e915 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:46:06.686746 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-5d6d427f-b2ec-40e1-b32a-32ca7d83e915 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: 6266e4c0-1dd9-4859-ae9c-ae17bbacae4b] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:46:06.693037 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5d6d427f-b2ec-40e1-b32a-32ca7d83e915 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:46:06.693494 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5d6d427f-b2ec-40e1-b32a-32ca7d83e915 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:46:06.694278 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5d6d427f-b2ec-40e1-b32a-32ca7d83e915 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:46:06.694715 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-5d6d427f-b2ec-40e1-b32a-32ca7d83e915 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:46:06.822515 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-5d6d427f-b2ec-40e1-b32a-32ca7d83e915 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484a37a0154a4f709815c5935aef8ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff117078def64108b7829db8db9baf7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:46:06.829628 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-5d6d427f-b2ec-40e1-b32a-32ca7d83e915 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/6266e4c0-1dd9-4859-ae9c-ae17bbacae4b" status: 200 len: 1265 microversion: 2.1 time: 0.147225 Dec 15 13:46:06.830697 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 672/1362] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:46:06 2021] GET /compute/v2.1/servers/6266e4c0-1dd9-4859-ae9c-ae17bbacae4b => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:46:07.847114 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-303f033b-a6e7-403d-affc-3ae39f515843 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:46:07.847733 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-303f033b-a6e7-403d-affc-3ae39f515843 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: 6266e4c0-1dd9-4859-ae9c-ae17bbacae4b] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:46:07.853971 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-303f033b-a6e7-403d-affc-3ae39f515843 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:46:07.854421 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-303f033b-a6e7-403d-affc-3ae39f515843 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:46:07.855248 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-303f033b-a6e7-403d-affc-3ae39f515843 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:46:07.855946 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-303f033b-a6e7-403d-affc-3ae39f515843 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:46:07.989385 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-303f033b-a6e7-403d-affc-3ae39f515843 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484a37a0154a4f709815c5935aef8ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff117078def64108b7829db8db9baf7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:46:07.996637 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-303f033b-a6e7-403d-affc-3ae39f515843 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/6266e4c0-1dd9-4859-ae9c-ae17bbacae4b" status: 200 len: 1265 microversion: 2.1 time: 0.153203 Dec 15 13:46:07.997202 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 691/1363] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:46:07 2021] GET /compute/v2.1/servers/6266e4c0-1dd9-4859-ae9c-ae17bbacae4b => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:46:09.012801 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-7e252bee-24af-47aa-8f22-2cc4af4ebd5b tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:46:09.013417 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-7e252bee-24af-47aa-8f22-2cc4af4ebd5b tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: 6266e4c0-1dd9-4859-ae9c-ae17bbacae4b] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:46:09.020256 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7e252bee-24af-47aa-8f22-2cc4af4ebd5b tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:46:09.020708 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7e252bee-24af-47aa-8f22-2cc4af4ebd5b tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:46:09.021488 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7e252bee-24af-47aa-8f22-2cc4af4ebd5b tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:46:09.021927 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-7e252bee-24af-47aa-8f22-2cc4af4ebd5b tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:46:09.206633 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-7e252bee-24af-47aa-8f22-2cc4af4ebd5b tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484a37a0154a4f709815c5935aef8ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff117078def64108b7829db8db9baf7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:46:09.216477 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-7e252bee-24af-47aa-8f22-2cc4af4ebd5b tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/6266e4c0-1dd9-4859-ae9c-ae17bbacae4b" status: 200 len: 1265 microversion: 2.1 time: 0.207328 Dec 15 13:46:09.217053 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 673/1364] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:46:09 2021] GET /compute/v2.1/servers/6266e4c0-1dd9-4859-ae9c-ae17bbacae4b => generated 1265 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:46:10.233455 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-97fc52f9-6541-4749-a220-49e430f76182 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:46:10.234119 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-97fc52f9-6541-4749-a220-49e430f76182 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: 6266e4c0-1dd9-4859-ae9c-ae17bbacae4b] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:46:10.240413 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-97fc52f9-6541-4749-a220-49e430f76182 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:46:10.240861 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-97fc52f9-6541-4749-a220-49e430f76182 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:46:10.241647 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-97fc52f9-6541-4749-a220-49e430f76182 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:46:10.242081 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-97fc52f9-6541-4749-a220-49e430f76182 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:46:10.374483 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-97fc52f9-6541-4749-a220-49e430f76182 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484a37a0154a4f709815c5935aef8ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff117078def64108b7829db8db9baf7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:46:10.381721 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-97fc52f9-6541-4749-a220-49e430f76182 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/6266e4c0-1dd9-4859-ae9c-ae17bbacae4b" status: 200 len: 1265 microversion: 2.1 time: 0.152194 Dec 15 13:46:10.382281 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 692/1365] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:46:10 2021] GET /compute/v2.1/servers/6266e4c0-1dd9-4859-ae9c-ae17bbacae4b => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:46:11.397355 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-38f9241a-e38c-4837-afab-c56662b38cd4 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:46:11.398443 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-38f9241a-e38c-4837-afab-c56662b38cd4 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: 6266e4c0-1dd9-4859-ae9c-ae17bbacae4b] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:46:11.407355 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-38f9241a-e38c-4837-afab-c56662b38cd4 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:46:11.407940 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-38f9241a-e38c-4837-afab-c56662b38cd4 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:46:11.409243 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-38f9241a-e38c-4837-afab-c56662b38cd4 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:46:11.409680 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-38f9241a-e38c-4837-afab-c56662b38cd4 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:46:11.539882 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-38f9241a-e38c-4837-afab-c56662b38cd4 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484a37a0154a4f709815c5935aef8ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff117078def64108b7829db8db9baf7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:46:11.547075 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-38f9241a-e38c-4837-afab-c56662b38cd4 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/6266e4c0-1dd9-4859-ae9c-ae17bbacae4b" status: 200 len: 1265 microversion: 2.1 time: 0.153404 Dec 15 13:46:11.547645 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 674/1366] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:46:11 2021] GET /compute/v2.1/servers/6266e4c0-1dd9-4859-ae9c-ae17bbacae4b => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:46:12.564192 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-c764c9bc-c3a8-4352-bf1a-1d1434da30b9 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:46:12.564925 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-c764c9bc-c3a8-4352-bf1a-1d1434da30b9 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: 6266e4c0-1dd9-4859-ae9c-ae17bbacae4b] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:46:12.571572 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c764c9bc-c3a8-4352-bf1a-1d1434da30b9 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:46:12.572026 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c764c9bc-c3a8-4352-bf1a-1d1434da30b9 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:46:12.572814 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c764c9bc-c3a8-4352-bf1a-1d1434da30b9 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:46:12.573256 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c764c9bc-c3a8-4352-bf1a-1d1434da30b9 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:46:12.701043 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-c764c9bc-c3a8-4352-bf1a-1d1434da30b9 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484a37a0154a4f709815c5935aef8ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff117078def64108b7829db8db9baf7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:46:12.708372 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-c764c9bc-c3a8-4352-bf1a-1d1434da30b9 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/6266e4c0-1dd9-4859-ae9c-ae17bbacae4b" status: 200 len: 1265 microversion: 2.1 time: 0.147861 Dec 15 13:46:12.708946 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 693/1367] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:46:12 2021] GET /compute/v2.1/servers/6266e4c0-1dd9-4859-ae9c-ae17bbacae4b => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:46:12.849898 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-2a4fc905-38cf-4216-b1db-0644ab469b4a req-5fe6661a-679b-4b31-a182-9399420b6fac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6266e4c0-1dd9-4859-ae9c-ae17bbacae4b", "name": "network-vif-plugged", "status": "completed", "tag": "e3401a55-6804-4ee1-aba8-8e5fd04ec241"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:46:12.851453 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:46:12.851453 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: warnings.warn(msg) Dec 15 13:46:12.859369 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-2a4fc905-38cf-4216-b1db-0644ab469b4a req-5fe6661a-679b-4b31-a182-9399420b6fac service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:46:12.859902 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-2a4fc905-38cf-4216-b1db-0644ab469b4a req-5fe6661a-679b-4b31-a182-9399420b6fac service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:46:12.871659 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-2a4fc905-38cf-4216-b1db-0644ab469b4a req-5fe6661a-679b-4b31-a182-9399420b6fac service nova] Creating event network-vif-plugged:e3401a55-6804-4ee1-aba8-8e5fd04ec241 for instance 6266e4c0-1dd9-4859-ae9c-ae17bbacae4b on hv-cinder-81322 Dec 15 13:46:12.876544 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-2a4fc905-38cf-4216-b1db-0644ab469b4a req-5fe6661a-679b-4b31-a182-9399420b6fac service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030277 Dec 15 13:46:12.877153 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 675/1368] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:46:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:46:13.725519 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-aff0b4b5-3bff-4b96-9856-7f7c695b8f52 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:46:13.726155 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-aff0b4b5-3bff-4b96-9856-7f7c695b8f52 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: 6266e4c0-1dd9-4859-ae9c-ae17bbacae4b] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:46:13.732630 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-aff0b4b5-3bff-4b96-9856-7f7c695b8f52 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:46:13.733072 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-aff0b4b5-3bff-4b96-9856-7f7c695b8f52 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:46:13.733849 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-aff0b4b5-3bff-4b96-9856-7f7c695b8f52 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:46:13.734282 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-aff0b4b5-3bff-4b96-9856-7f7c695b8f52 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:46:13.865505 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-aff0b4b5-3bff-4b96-9856-7f7c695b8f52 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484a37a0154a4f709815c5935aef8ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff117078def64108b7829db8db9baf7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:46:13.872643 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-aff0b4b5-3bff-4b96-9856-7f7c695b8f52 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/6266e4c0-1dd9-4859-ae9c-ae17bbacae4b" status: 200 len: 1265 microversion: 2.1 time: 0.151337 Dec 15 13:46:13.873217 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 694/1369] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:46:13 2021] GET /compute/v2.1/servers/6266e4c0-1dd9-4859-ae9c-ae17bbacae4b => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:46:14.890165 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-fba014e8-2521-4a72-8838-cd6a65afb28f tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:46:14.890887 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-fba014e8-2521-4a72-8838-cd6a65afb28f tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: 6266e4c0-1dd9-4859-ae9c-ae17bbacae4b] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:46:14.897503 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-fba014e8-2521-4a72-8838-cd6a65afb28f tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:46:14.897962 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-fba014e8-2521-4a72-8838-cd6a65afb28f tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:46:14.898746 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-fba014e8-2521-4a72-8838-cd6a65afb28f tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:46:14.899216 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-fba014e8-2521-4a72-8838-cd6a65afb28f tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:46:15.027845 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-fba014e8-2521-4a72-8838-cd6a65afb28f tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484a37a0154a4f709815c5935aef8ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff117078def64108b7829db8db9baf7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:46:15.035800 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-fba014e8-2521-4a72-8838-cd6a65afb28f tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/6266e4c0-1dd9-4859-ae9c-ae17bbacae4b" status: 200 len: 1452 microversion: 2.1 time: 0.150200 Dec 15 13:46:15.036368 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 676/1370] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:46:14 2021] GET /compute/v2.1/servers/6266e4c0-1dd9-4859-ae9c-ae17bbacae4b => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:46:15.051452 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-9c84ad48-a1cb-4aac-8002-988bae6549ec tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:46:15.052084 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-9c84ad48-a1cb-4aac-8002-988bae6549ec tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: 6266e4c0-1dd9-4859-ae9c-ae17bbacae4b] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:46:15.058306 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9c84ad48-a1cb-4aac-8002-988bae6549ec tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:46:15.058757 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9c84ad48-a1cb-4aac-8002-988bae6549ec tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:46:15.059968 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9c84ad48-a1cb-4aac-8002-988bae6549ec tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:46:15.060075 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9c84ad48-a1cb-4aac-8002-988bae6549ec tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:46:15.191884 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-9c84ad48-a1cb-4aac-8002-988bae6549ec tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484a37a0154a4f709815c5935aef8ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff117078def64108b7829db8db9baf7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:46:15.199165 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-9c84ad48-a1cb-4aac-8002-988bae6549ec tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/6266e4c0-1dd9-4859-ae9c-ae17bbacae4b" status: 200 len: 1452 microversion: 2.1 time: 0.151359 Dec 15 13:46:15.199742 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 695/1371] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:46:15 2021] GET /compute/v2.1/servers/6266e4c0-1dd9-4859-ae9c-ae17bbacae4b => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:46:16.747405 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-c200bf29-7137-4f15-a4f6-f5208e71643d req-7d9a38eb-45a1-4490-b8c6-66114d8e1c5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6266e4c0-1dd9-4859-ae9c-ae17bbacae4b", "tag": "e3401a55-6804-4ee1-aba8-8e5fd04ec241"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:46:16.748905 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:46:16.748905 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: warnings.warn(msg) Dec 15 13:46:16.756724 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-c200bf29-7137-4f15-a4f6-f5208e71643d req-7d9a38eb-45a1-4490-b8c6-66114d8e1c5f service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:46:16.757159 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-c200bf29-7137-4f15-a4f6-f5208e71643d req-7d9a38eb-45a1-4490-b8c6-66114d8e1c5f service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:46:16.767747 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-c200bf29-7137-4f15-a4f6-f5208e71643d req-7d9a38eb-45a1-4490-b8c6-66114d8e1c5f service nova] Creating event network-changed:e3401a55-6804-4ee1-aba8-8e5fd04ec241 for instance 6266e4c0-1dd9-4859-ae9c-ae17bbacae4b on hv-cinder-81322 Dec 15 13:46:16.773208 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-c200bf29-7137-4f15-a4f6-f5208e71643d req-7d9a38eb-45a1-4490-b8c6-66114d8e1c5f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029454 Dec 15 13:46:16.773966 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 677/1372] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:46:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:47:34.415521 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:47:34.416175 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: Wed Dec 15 13:47:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 13:47:46.901645 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:47:46.902140 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: Wed Dec 15 13:47:46 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 13:48:27.032925 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-c201b03b-bf09-480b-9e63-9e125f3eae8d tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1456839052", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-825054983", "security_groups": [{"name": "tempest-secgroup-smoke-316724650"}], "block_device_mapping_v2": [{"uuid": "770c7d9a-c994-45b7-976a-65ca55f12d2f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "594ca57d-8cb7-438b-9dfc-7ea84a39a8ac"}]}} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:48:27.139262 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.network.neutron [None req-c201b03b-bf09-480b-9e63-9e125f3eae8d tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] validate_networks() for [('594ca57d-8cb7-438b-9dfc-7ea84a39a8ac', None, None, None, None, None)] {{(pid=116942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:48:27.487517 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-c201b03b-bf09-480b-9e63-9e125f3eae8d tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Flavor limits 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:48:27.487949 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-c201b03b-bf09-480b-9e63-9e125f3eae8d tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Image limits 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:48:27.488457 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-c201b03b-bf09-480b-9e63-9e125f3eae8d tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Flavor pref 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:48:27.488874 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-c201b03b-bf09-480b-9e63-9e125f3eae8d tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Image pref 0:0:0 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:48:27.489291 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.virt.hardware [None req-c201b03b-bf09-480b-9e63-9e125f3eae8d tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:48:27.498494 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c201b03b-bf09-480b-9e63-9e125f3eae8d tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:48:27.498931 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c201b03b-bf09-480b-9e63-9e125f3eae8d tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:48:27.499762 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c201b03b-bf09-480b-9e63-9e125f3eae8d tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:48:27.500207 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c201b03b-bf09-480b-9e63-9e125f3eae8d tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:48:27.516751 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-c201b03b-bf09-480b-9e63-9e125f3eae8d tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Getting quotas for project ff117078def64108b7829db8db9baf7f. Resources: {'cores', 'instances', 'ram'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:48:27.520455 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.quota [None req-c201b03b-bf09-480b-9e63-9e125f3eae8d tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Getting quotas for user 484a37a0154a4f709815c5935aef8ec2 and project ff117078def64108b7829db8db9baf7f. Resources: {'cores', 'instances', 'ram'} {{(pid=116942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:48:27.572683 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-c201b03b-bf09-480b-9e63-9e125f3eae8d tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Going to run 1 instances... {{(pid=116942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:48:27.575389 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-c201b03b-bf09-480b-9e63-9e125f3eae8d tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: f8bbe639-2f99-4da5-98e1-dbd921cd2de9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='770c7d9a-c994-45b7-976a-65ca55f12d2f',volume_size=None,volume_type=None)] {{(pid=116942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:48:27.695798 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-c201b03b-bf09-480b-9e63-9e125f3eae8d tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.667483 Dec 15 13:48:27.696566 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 696/1373] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Dec 15 13:48:27 2021] POST /compute/v2.1/servers => generated 405 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 13:48:27.705134 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9ec0e50f-cbc7-434f-bbd3-e475e0769c3a] AMQP server on 10.222.0.60:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Dec 15 13:48:27.709020 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-b37235cf-1453-4771-97ee-53badff1cc63 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:48:27.709714 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-b37235cf-1453-4771-97ee-53badff1cc63 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: f8bbe639-2f99-4da5-98e1-dbd921cd2de9] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:48:27.772347 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-b37235cf-1453-4771-97ee-53badff1cc63 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484a37a0154a4f709815c5935aef8ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff117078def64108b7829db8db9baf7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:48:27.779761 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-b37235cf-1453-4771-97ee-53badff1cc63 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/f8bbe639-2f99-4da5-98e1-dbd921cd2de9" status: 200 len: 1094 microversion: 2.1 time: 0.076448 Dec 15 13:48:27.780423 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 678/1374] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:48:27 2021] GET /compute/v2.1/servers/f8bbe639-2f99-4da5-98e1-dbd921cd2de9 => generated 1094 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:48:28.797425 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-d42b6d3d-9200-4aa7-bde1-aca7a47424ba tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:48:28.798074 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-d42b6d3d-9200-4aa7-bde1-aca7a47424ba tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: f8bbe639-2f99-4da5-98e1-dbd921cd2de9] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:48:28.803958 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d42b6d3d-9200-4aa7-bde1-aca7a47424ba tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:48:28.804417 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d42b6d3d-9200-4aa7-bde1-aca7a47424ba tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:48:28.805200 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d42b6d3d-9200-4aa7-bde1-aca7a47424ba tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:48:28.805637 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-d42b6d3d-9200-4aa7-bde1-aca7a47424ba tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:48:28.864740 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-d42b6d3d-9200-4aa7-bde1-aca7a47424ba tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484a37a0154a4f709815c5935aef8ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff117078def64108b7829db8db9baf7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:48:28.872557 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-d42b6d3d-9200-4aa7-bde1-aca7a47424ba tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/f8bbe639-2f99-4da5-98e1-dbd921cd2de9" status: 200 len: 1210 microversion: 2.1 time: 0.079397 Dec 15 13:48:28.873044 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 697/1375] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:48:28 2021] GET /compute/v2.1/servers/f8bbe639-2f99-4da5-98e1-dbd921cd2de9 => generated 1210 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:48:29.891238 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-a08c9265-c193-45b5-9a76-bdf6b820942a tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:48:29.891748 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-a08c9265-c193-45b5-9a76-bdf6b820942a tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: f8bbe639-2f99-4da5-98e1-dbd921cd2de9] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:48:29.909389 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a08c9265-c193-45b5-9a76-bdf6b820942a tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:48:29.909850 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a08c9265-c193-45b5-9a76-bdf6b820942a tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:48:29.910653 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a08c9265-c193-45b5-9a76-bdf6b820942a tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:48:29.911128 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-a08c9265-c193-45b5-9a76-bdf6b820942a tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:48:29.926197 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO oslo.messaging._drivers.impl_rabbit [-] [9ec0e50f-cbc7-434f-bbd3-e475e0769c3a] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 51050. Dec 15 13:48:30.035025 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-f8b8315c-564d-4ac4-8c92-6efea404cb95 req-b24f87f5-a02d-4bf1-9c17-fa692808798b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8bbe639-2f99-4da5-98e1-dbd921cd2de9", "tag": "39008b1f-a016-47f1-9046-a2c4d21ba9ca"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:48:30.037633 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:48:30.037633 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: warnings.warn(msg) Dec 15 13:48:30.045477 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-f8b8315c-564d-4ac4-8c92-6efea404cb95 req-b24f87f5-a02d-4bf1-9c17-fa692808798b service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:48:30.046027 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-f8b8315c-564d-4ac4-8c92-6efea404cb95 req-b24f87f5-a02d-4bf1-9c17-fa692808798b service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:48:30.061347 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-f8b8315c-564d-4ac4-8c92-6efea404cb95 req-b24f87f5-a02d-4bf1-9c17-fa692808798b service nova] Creating event network-changed:39008b1f-a016-47f1-9046-a2c4d21ba9ca for instance f8bbe639-2f99-4da5-98e1-dbd921cd2de9 on hv-cinder-81322 Dec 15 13:48:30.066941 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-f8b8315c-564d-4ac4-8c92-6efea404cb95 req-b24f87f5-a02d-4bf1-9c17-fa692808798b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120174 Dec 15 13:48:30.067854 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 698/1376] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:48:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:48:30.082139 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-a08c9265-c193-45b5-9a76-bdf6b820942a tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484a37a0154a4f709815c5935aef8ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff117078def64108b7829db8db9baf7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:48:30.091178 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-a08c9265-c193-45b5-9a76-bdf6b820942a tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/f8bbe639-2f99-4da5-98e1-dbd921cd2de9" status: 200 len: 1265 microversion: 2.1 time: 0.203553 Dec 15 13:48:30.091771 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 679/1377] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:48:29 2021] GET /compute/v2.1/servers/f8bbe639-2f99-4da5-98e1-dbd921cd2de9 => generated 1265 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:48:31.109765 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-66577fa2-38af-4616-b5b7-224ecf24fdb4 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:48:31.110466 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-66577fa2-38af-4616-b5b7-224ecf24fdb4 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: f8bbe639-2f99-4da5-98e1-dbd921cd2de9] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:48:31.116502 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-66577fa2-38af-4616-b5b7-224ecf24fdb4 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:48:31.116954 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-66577fa2-38af-4616-b5b7-224ecf24fdb4 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:48:31.117990 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-66577fa2-38af-4616-b5b7-224ecf24fdb4 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:48:31.118431 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-66577fa2-38af-4616-b5b7-224ecf24fdb4 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:48:31.247693 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-66577fa2-38af-4616-b5b7-224ecf24fdb4 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484a37a0154a4f709815c5935aef8ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff117078def64108b7829db8db9baf7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:48:31.255017 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-66577fa2-38af-4616-b5b7-224ecf24fdb4 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/f8bbe639-2f99-4da5-98e1-dbd921cd2de9" status: 200 len: 1265 microversion: 2.1 time: 0.150218 Dec 15 13:48:31.255593 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 699/1378] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:48:31 2021] GET /compute/v2.1/servers/f8bbe639-2f99-4da5-98e1-dbd921cd2de9 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:48:32.271549 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-86b71dd9-b2ad-4580-9eca-1101a7e5a347 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:48:32.272231 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-86b71dd9-b2ad-4580-9eca-1101a7e5a347 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: f8bbe639-2f99-4da5-98e1-dbd921cd2de9] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:48:32.279055 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-86b71dd9-b2ad-4580-9eca-1101a7e5a347 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:48:32.279511 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-86b71dd9-b2ad-4580-9eca-1101a7e5a347 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:48:32.280342 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-86b71dd9-b2ad-4580-9eca-1101a7e5a347 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:48:32.280779 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-86b71dd9-b2ad-4580-9eca-1101a7e5a347 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:48:32.413904 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-86b71dd9-b2ad-4580-9eca-1101a7e5a347 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484a37a0154a4f709815c5935aef8ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff117078def64108b7829db8db9baf7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:48:32.421686 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-86b71dd9-b2ad-4580-9eca-1101a7e5a347 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/f8bbe639-2f99-4da5-98e1-dbd921cd2de9" status: 200 len: 1265 microversion: 2.1 time: 0.153811 Dec 15 13:48:32.422261 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 680/1379] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:48:32 2021] GET /compute/v2.1/servers/f8bbe639-2f99-4da5-98e1-dbd921cd2de9 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:48:33.437757 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-16d02264-36f1-4760-a602-42b1c99b58eb tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:48:33.438411 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-16d02264-36f1-4760-a602-42b1c99b58eb tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: f8bbe639-2f99-4da5-98e1-dbd921cd2de9] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:48:33.444659 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-16d02264-36f1-4760-a602-42b1c99b58eb tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:48:33.445108 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-16d02264-36f1-4760-a602-42b1c99b58eb tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:48:33.445886 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-16d02264-36f1-4760-a602-42b1c99b58eb tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:48:33.446326 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-16d02264-36f1-4760-a602-42b1c99b58eb tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:48:33.574616 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-16d02264-36f1-4760-a602-42b1c99b58eb tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484a37a0154a4f709815c5935aef8ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff117078def64108b7829db8db9baf7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:48:33.581980 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-16d02264-36f1-4760-a602-42b1c99b58eb tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/f8bbe639-2f99-4da5-98e1-dbd921cd2de9" status: 200 len: 1265 microversion: 2.1 time: 0.148504 Dec 15 13:48:33.582555 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 700/1380] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:48:33 2021] GET /compute/v2.1/servers/f8bbe639-2f99-4da5-98e1-dbd921cd2de9 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:48:34.599070 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-edfbfe70-5239-44cb-98cd-15bbd582faf8 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:48:34.599687 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-edfbfe70-5239-44cb-98cd-15bbd582faf8 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: f8bbe639-2f99-4da5-98e1-dbd921cd2de9] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:48:34.605916 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-edfbfe70-5239-44cb-98cd-15bbd582faf8 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:48:34.606375 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-edfbfe70-5239-44cb-98cd-15bbd582faf8 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:48:34.607189 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-edfbfe70-5239-44cb-98cd-15bbd582faf8 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:48:34.607633 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-edfbfe70-5239-44cb-98cd-15bbd582faf8 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:48:34.735916 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-edfbfe70-5239-44cb-98cd-15bbd582faf8 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484a37a0154a4f709815c5935aef8ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff117078def64108b7829db8db9baf7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:48:34.743433 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-edfbfe70-5239-44cb-98cd-15bbd582faf8 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/f8bbe639-2f99-4da5-98e1-dbd921cd2de9" status: 200 len: 1265 microversion: 2.1 time: 0.147778 Dec 15 13:48:34.744010 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 681/1381] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:48:34 2021] GET /compute/v2.1/servers/f8bbe639-2f99-4da5-98e1-dbd921cd2de9 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:48:35.760518 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-9535701c-64f7-4f00-a2b1-18cac7860e36 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:48:35.761128 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-9535701c-64f7-4f00-a2b1-18cac7860e36 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: f8bbe639-2f99-4da5-98e1-dbd921cd2de9] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:48:35.768004 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9535701c-64f7-4f00-a2b1-18cac7860e36 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:48:35.768453 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9535701c-64f7-4f00-a2b1-18cac7860e36 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:48:35.769234 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9535701c-64f7-4f00-a2b1-18cac7860e36 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:48:35.769667 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-9535701c-64f7-4f00-a2b1-18cac7860e36 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:48:35.901422 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-9535701c-64f7-4f00-a2b1-18cac7860e36 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484a37a0154a4f709815c5935aef8ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff117078def64108b7829db8db9baf7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:48:35.908560 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-9535701c-64f7-4f00-a2b1-18cac7860e36 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/f8bbe639-2f99-4da5-98e1-dbd921cd2de9" status: 200 len: 1265 microversion: 2.1 time: 0.151682 Dec 15 13:48:35.909125 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 701/1382] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:48:35 2021] GET /compute/v2.1/servers/f8bbe639-2f99-4da5-98e1-dbd921cd2de9 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:48:36.924653 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-214d29d3-1d13-47e7-acab-4751d6cd55a0 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:48:36.925263 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-214d29d3-1d13-47e7-acab-4751d6cd55a0 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: f8bbe639-2f99-4da5-98e1-dbd921cd2de9] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:48:36.931541 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-214d29d3-1d13-47e7-acab-4751d6cd55a0 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:48:36.932048 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-214d29d3-1d13-47e7-acab-4751d6cd55a0 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:48:36.932828 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-214d29d3-1d13-47e7-acab-4751d6cd55a0 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:48:36.933294 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-214d29d3-1d13-47e7-acab-4751d6cd55a0 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:48:37.061626 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-214d29d3-1d13-47e7-acab-4751d6cd55a0 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484a37a0154a4f709815c5935aef8ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff117078def64108b7829db8db9baf7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:48:37.068799 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-214d29d3-1d13-47e7-acab-4751d6cd55a0 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/f8bbe639-2f99-4da5-98e1-dbd921cd2de9" status: 200 len: 1265 microversion: 2.1 time: 0.147977 Dec 15 13:48:37.069364 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 682/1383] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:48:36 2021] GET /compute/v2.1/servers/f8bbe639-2f99-4da5-98e1-dbd921cd2de9 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:48:38.085654 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-54780725-c885-47a0-9659-d6265f232be7 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:48:38.086268 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-54780725-c885-47a0-9659-d6265f232be7 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: f8bbe639-2f99-4da5-98e1-dbd921cd2de9] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:48:38.093061 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-54780725-c885-47a0-9659-d6265f232be7 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:48:38.093520 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-54780725-c885-47a0-9659-d6265f232be7 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:48:38.094302 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-54780725-c885-47a0-9659-d6265f232be7 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:48:38.094764 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-54780725-c885-47a0-9659-d6265f232be7 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:48:38.224934 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-54780725-c885-47a0-9659-d6265f232be7 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484a37a0154a4f709815c5935aef8ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff117078def64108b7829db8db9baf7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:48:38.232776 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-54780725-c885-47a0-9659-d6265f232be7 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/f8bbe639-2f99-4da5-98e1-dbd921cd2de9" status: 200 len: 1265 microversion: 2.1 time: 0.150743 Dec 15 13:48:38.233342 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 702/1384] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:48:38 2021] GET /compute/v2.1/servers/f8bbe639-2f99-4da5-98e1-dbd921cd2de9 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:48:39.250035 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-16bb185e-bf1e-4c1b-b869-6f58a41c66bd tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:48:39.250758 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-16bb185e-bf1e-4c1b-b869-6f58a41c66bd tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: f8bbe639-2f99-4da5-98e1-dbd921cd2de9] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:48:39.257296 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-16bb185e-bf1e-4c1b-b869-6f58a41c66bd tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:48:39.257296 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-16bb185e-bf1e-4c1b-b869-6f58a41c66bd tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:48:39.258043 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-16bb185e-bf1e-4c1b-b869-6f58a41c66bd tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:48:39.258478 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-16bb185e-bf1e-4c1b-b869-6f58a41c66bd tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:48:39.386362 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-16bb185e-bf1e-4c1b-b869-6f58a41c66bd tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484a37a0154a4f709815c5935aef8ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff117078def64108b7829db8db9baf7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:48:39.393555 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-16bb185e-bf1e-4c1b-b869-6f58a41c66bd tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/f8bbe639-2f99-4da5-98e1-dbd921cd2de9" status: 200 len: 1265 microversion: 2.1 time: 0.147678 Dec 15 13:48:39.394123 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 683/1385] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:48:39 2021] GET /compute/v2.1/servers/f8bbe639-2f99-4da5-98e1-dbd921cd2de9 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:48:40.410067 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-92817f7c-5e83-46e5-838d-96841b2a191a tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:48:40.410686 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-92817f7c-5e83-46e5-838d-96841b2a191a tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: f8bbe639-2f99-4da5-98e1-dbd921cd2de9] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:48:40.416990 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-92817f7c-5e83-46e5-838d-96841b2a191a tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:48:40.417456 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-92817f7c-5e83-46e5-838d-96841b2a191a tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:48:40.418872 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-92817f7c-5e83-46e5-838d-96841b2a191a tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:48:40.419317 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-92817f7c-5e83-46e5-838d-96841b2a191a tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:48:40.547703 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-92817f7c-5e83-46e5-838d-96841b2a191a tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484a37a0154a4f709815c5935aef8ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff117078def64108b7829db8db9baf7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:48:40.555129 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-92817f7c-5e83-46e5-838d-96841b2a191a tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/f8bbe639-2f99-4da5-98e1-dbd921cd2de9" status: 200 len: 1265 microversion: 2.1 time: 0.148641 Dec 15 13:48:40.555701 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 703/1386] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:48:40 2021] GET /compute/v2.1/servers/f8bbe639-2f99-4da5-98e1-dbd921cd2de9 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:48:41.572289 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-f0b369e4-2ba7-4afe-b977-3eef5b55306d tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:48:41.572903 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-f0b369e4-2ba7-4afe-b977-3eef5b55306d tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: f8bbe639-2f99-4da5-98e1-dbd921cd2de9] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:48:41.579779 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f0b369e4-2ba7-4afe-b977-3eef5b55306d tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:48:41.580226 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f0b369e4-2ba7-4afe-b977-3eef5b55306d tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:48:41.581002 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f0b369e4-2ba7-4afe-b977-3eef5b55306d tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:48:41.581437 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-f0b369e4-2ba7-4afe-b977-3eef5b55306d tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:48:41.717802 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-f0b369e4-2ba7-4afe-b977-3eef5b55306d tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484a37a0154a4f709815c5935aef8ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff117078def64108b7829db8db9baf7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:48:41.725299 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-f0b369e4-2ba7-4afe-b977-3eef5b55306d tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/f8bbe639-2f99-4da5-98e1-dbd921cd2de9" status: 200 len: 1265 microversion: 2.1 time: 0.156747 Dec 15 13:48:41.725879 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 684/1387] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:48:41 2021] GET /compute/v2.1/servers/f8bbe639-2f99-4da5-98e1-dbd921cd2de9 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:48:41.801521 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-6afd0452-b055-4911-b000-3b909109dabc req-d2224087-a39b-4e42-939f-af0ab557545f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8bbe639-2f99-4da5-98e1-dbd921cd2de9", "name": "network-vif-plugged", "status": "completed", "tag": "39008b1f-a016-47f1-9046-a2c4d21ba9ca"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:48:41.803105 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:48:41.803105 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: warnings.warn(msg) Dec 15 13:48:41.810469 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-6afd0452-b055-4911-b000-3b909109dabc req-d2224087-a39b-4e42-939f-af0ab557545f service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:48:41.810943 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-6afd0452-b055-4911-b000-3b909109dabc req-d2224087-a39b-4e42-939f-af0ab557545f service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:48:41.821414 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-6afd0452-b055-4911-b000-3b909109dabc req-d2224087-a39b-4e42-939f-af0ab557545f service nova] Creating event network-vif-plugged:39008b1f-a016-47f1-9046-a2c4d21ba9ca for instance f8bbe639-2f99-4da5-98e1-dbd921cd2de9 on hv-cinder-81322 Dec 15 13:48:41.826961 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-6afd0452-b055-4911-b000-3b909109dabc req-d2224087-a39b-4e42-939f-af0ab557545f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094558 Dec 15 13:48:41.827528 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 704/1388] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:48:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:48:42.741459 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-918c5390-da9b-437f-ac2e-5201446bcd97 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:48:42.742068 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-918c5390-da9b-437f-ac2e-5201446bcd97 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: f8bbe639-2f99-4da5-98e1-dbd921cd2de9] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:48:42.748566 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-918c5390-da9b-437f-ac2e-5201446bcd97 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:48:42.749015 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-918c5390-da9b-437f-ac2e-5201446bcd97 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:48:42.749788 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-918c5390-da9b-437f-ac2e-5201446bcd97 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:48:42.750222 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-918c5390-da9b-437f-ac2e-5201446bcd97 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:48:42.877337 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-918c5390-da9b-437f-ac2e-5201446bcd97 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484a37a0154a4f709815c5935aef8ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff117078def64108b7829db8db9baf7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:48:42.884496 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-918c5390-da9b-437f-ac2e-5201446bcd97 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/f8bbe639-2f99-4da5-98e1-dbd921cd2de9" status: 200 len: 1265 microversion: 2.1 time: 0.146740 Dec 15 13:48:42.885064 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 685/1389] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:48:42 2021] GET /compute/v2.1/servers/f8bbe639-2f99-4da5-98e1-dbd921cd2de9 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:48:43.903445 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-deea7bc5-b9ff-4228-9797-94758c9f750e tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:48:43.904143 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-deea7bc5-b9ff-4228-9797-94758c9f750e tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: f8bbe639-2f99-4da5-98e1-dbd921cd2de9] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:48:43.910157 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-deea7bc5-b9ff-4228-9797-94758c9f750e tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:48:43.910603 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-deea7bc5-b9ff-4228-9797-94758c9f750e tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:48:43.911412 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-deea7bc5-b9ff-4228-9797-94758c9f750e tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:48:43.911845 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-deea7bc5-b9ff-4228-9797-94758c9f750e tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:48:44.250981 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-deea7bc5-b9ff-4228-9797-94758c9f750e tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484a37a0154a4f709815c5935aef8ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff117078def64108b7829db8db9baf7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:48:44.258226 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-deea7bc5-b9ff-4228-9797-94758c9f750e tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/f8bbe639-2f99-4da5-98e1-dbd921cd2de9" status: 200 len: 1453 microversion: 2.1 time: 0.359922 Dec 15 13:48:44.258798 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 705/1390] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:48:43 2021] GET /compute/v2.1/servers/f8bbe639-2f99-4da5-98e1-dbd921cd2de9 => generated 1453 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:48:44.275096 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-ed75df20-a7a1-4b2d-b276-6349aeaf1c4c tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:48:44.275704 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-ed75df20-a7a1-4b2d-b276-6349aeaf1c4c tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: f8bbe639-2f99-4da5-98e1-dbd921cd2de9] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:48:44.281827 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ed75df20-a7a1-4b2d-b276-6349aeaf1c4c tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:48:44.282269 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ed75df20-a7a1-4b2d-b276-6349aeaf1c4c tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:48:44.283071 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ed75df20-a7a1-4b2d-b276-6349aeaf1c4c tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:48:44.283504 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ed75df20-a7a1-4b2d-b276-6349aeaf1c4c tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:48:44.409112 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-ed75df20-a7a1-4b2d-b276-6349aeaf1c4c tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484a37a0154a4f709815c5935aef8ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff117078def64108b7829db8db9baf7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:48:44.416321 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-ed75df20-a7a1-4b2d-b276-6349aeaf1c4c tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/f8bbe639-2f99-4da5-98e1-dbd921cd2de9" status: 200 len: 1453 microversion: 2.1 time: 0.145226 Dec 15 13:48:44.416894 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 686/1391] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:48:44 2021] GET /compute/v2.1/servers/f8bbe639-2f99-4da5-98e1-dbd921cd2de9 => generated 1453 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:48:46.148922 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-c8aeb785-a6e7-49f3-8388-0d93bb99530c req-3b1d38cc-a316-45c3-8ee1-20185b38de55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8bbe639-2f99-4da5-98e1-dbd921cd2de9", "tag": "39008b1f-a016-47f1-9046-a2c4d21ba9ca"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:48:46.150435 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:48:46.150435 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: warnings.warn(msg) Dec 15 13:48:46.157694 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-c8aeb785-a6e7-49f3-8388-0d93bb99530c req-3b1d38cc-a316-45c3-8ee1-20185b38de55 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:48:46.158163 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-c8aeb785-a6e7-49f3-8388-0d93bb99530c req-3b1d38cc-a316-45c3-8ee1-20185b38de55 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:48:46.170134 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-c8aeb785-a6e7-49f3-8388-0d93bb99530c req-3b1d38cc-a316-45c3-8ee1-20185b38de55 service nova] Creating event network-changed:39008b1f-a016-47f1-9046-a2c4d21ba9ca for instance f8bbe639-2f99-4da5-98e1-dbd921cd2de9 on hv-cinder-81322 Dec 15 13:48:46.175416 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-c8aeb785-a6e7-49f3-8388-0d93bb99530c req-3b1d38cc-a316-45c3-8ee1-20185b38de55 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086201 Dec 15 13:48:46.176071 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 706/1392] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:48:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:49:20.980684 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:49:20.981274 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: Wed Dec 15 13:49:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 13:50:35.828655 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: ERROR oslo.messaging._drivers.impl_rabbit [-] [12c04aca-e0de-4513-9e04-80226c05c50d] AMQP server on 10.222.0.60:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Dec 15 13:50:35.829181 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-1aedd0aa-a987-42da-94b2-a6fb3a7b28d9 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:50:35.829548 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-1aedd0aa-a987-42da-94b2-a6fb3a7b28d9 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: f8bbe639-2f99-4da5-98e1-dbd921cd2de9] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:50:35.833874 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-c874eb33-ab78-40b7-9393-93919da11184 req-1f10889c-c7be-46d9-a12c-43e02bc7d469 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8bbe639-2f99-4da5-98e1-dbd921cd2de9", "tag": "39008b1f-a016-47f1-9046-a2c4d21ba9ca"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:50:35.835511 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1aedd0aa-a987-42da-94b2-a6fb3a7b28d9 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:50:35.835836 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:50:35.835836 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: warnings.warn(msg) Dec 15 13:50:35.836073 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1aedd0aa-a987-42da-94b2-a6fb3a7b28d9 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:50:35.836933 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1aedd0aa-a987-42da-94b2-a6fb3a7b28d9 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:50:35.837426 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-1aedd0aa-a987-42da-94b2-a6fb3a7b28d9 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:50:35.844574 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-c874eb33-ab78-40b7-9393-93919da11184 req-1f10889c-c7be-46d9-a12c-43e02bc7d469 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:50:35.845018 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-c874eb33-ab78-40b7-9393-93919da11184 req-1f10889c-c7be-46d9-a12c-43e02bc7d469 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:50:35.856856 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-c874eb33-ab78-40b7-9393-93919da11184 req-1f10889c-c7be-46d9-a12c-43e02bc7d469 service nova] Creating event network-changed:39008b1f-a016-47f1-9046-a2c4d21ba9ca for instance f8bbe639-2f99-4da5-98e1-dbd921cd2de9 on hv-cinder-81322 Dec 15 13:50:35.862814 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-c874eb33-ab78-40b7-9393-93919da11184 req-1f10889c-c7be-46d9-a12c-43e02bc7d469 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035922 Dec 15 13:50:35.863854 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 707/1393] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:50:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:50:35.865128 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-1aedd0aa-a987-42da-94b2-a6fb3a7b28d9 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: f8bbe639-2f99-4da5-98e1-dbd921cd2de9] Going to try to terminate instance {{(pid=116941) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:50:35.929357 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1aedd0aa-a987-42da-94b2-a6fb3a7b28d9 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [2eaf1cbf-c46f-4394-abf1-edc95fd2e7da] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 15 13:50:36.945877 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO oslo.messaging._drivers.impl_rabbit [None req-1aedd0aa-a987-42da-94b2-a6fb3a7b28d9 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [2eaf1cbf-c46f-4394-abf1-edc95fd2e7da] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 51136. Dec 15 13:50:36.965651 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-1aedd0aa-a987-42da-94b2-a6fb3a7b28d9 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f8bbe639-2f99-4da5-98e1-dbd921cd2de9" status: 204 len: 0 microversion: 2.1 time: 1.141448 Dec 15 13:50:36.966249 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 687/1394] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Dec 15 13:50:35 2021] DELETE /compute/v2.1/servers/f8bbe639-2f99-4da5-98e1-dbd921cd2de9 => generated 0 bytes in 1143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:50:36.986355 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-acdf0ee4-d09c-4184-901b-f2f4c14231f4 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:50:36.987124 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-acdf0ee4-d09c-4184-901b-f2f4c14231f4 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: f8bbe639-2f99-4da5-98e1-dbd921cd2de9] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:50:36.995077 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-acdf0ee4-d09c-4184-901b-f2f4c14231f4 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:50:36.995077 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-acdf0ee4-d09c-4184-901b-f2f4c14231f4 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:50:36.995664 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-acdf0ee4-d09c-4184-901b-f2f4c14231f4 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:50:36.997257 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-acdf0ee4-d09c-4184-901b-f2f4c14231f4 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:50:37.019580 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO oslo.messaging._drivers.impl_rabbit [-] [12c04aca-e0de-4513-9e04-80226c05c50d] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 51140. Dec 15 13:50:37.131226 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-acdf0ee4-d09c-4184-901b-f2f4c14231f4 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484a37a0154a4f709815c5935aef8ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff117078def64108b7829db8db9baf7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:50:37.138442 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-acdf0ee4-d09c-4184-901b-f2f4c14231f4 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/f8bbe639-2f99-4da5-98e1-dbd921cd2de9" status: 200 len: 1459 microversion: 2.1 time: 0.167173 Dec 15 13:50:37.139037 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 708/1395] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:50:36 2021] GET /compute/v2.1/servers/f8bbe639-2f99-4da5-98e1-dbd921cd2de9 => generated 1459 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:50:38.156089 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-ad6cba09-8a32-42ae-8a49-4a32b098b341 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:50:38.156794 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-ad6cba09-8a32-42ae-8a49-4a32b098b341 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: f8bbe639-2f99-4da5-98e1-dbd921cd2de9] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:50:38.163732 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ad6cba09-8a32-42ae-8a49-4a32b098b341 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:50:38.164185 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ad6cba09-8a32-42ae-8a49-4a32b098b341 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:50:38.164960 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ad6cba09-8a32-42ae-8a49-4a32b098b341 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:50:38.165399 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-ad6cba09-8a32-42ae-8a49-4a32b098b341 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:50:38.297497 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-ad6cba09-8a32-42ae-8a49-4a32b098b341 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484a37a0154a4f709815c5935aef8ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff117078def64108b7829db8db9baf7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:50:38.304773 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-ad6cba09-8a32-42ae-8a49-4a32b098b341 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/f8bbe639-2f99-4da5-98e1-dbd921cd2de9" status: 200 len: 1459 microversion: 2.1 time: 0.153395 Dec 15 13:50:38.305349 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 688/1396] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:50:38 2021] GET /compute/v2.1/servers/f8bbe639-2f99-4da5-98e1-dbd921cd2de9 => generated 1459 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:50:39.078309 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-3f7191c9-9531-4de7-af7a-3339fdaac7fa req-5e09ac07-1dc4-4f5f-968f-22500ad76079 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8bbe639-2f99-4da5-98e1-dbd921cd2de9", "name": "network-vif-deleted", "tag": "39008b1f-a016-47f1-9046-a2c4d21ba9ca"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:50:39.079981 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:50:39.079981 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: warnings.warn(msg) Dec 15 13:50:39.088396 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-3f7191c9-9531-4de7-af7a-3339fdaac7fa req-5e09ac07-1dc4-4f5f-968f-22500ad76079 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:50:39.088847 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-3f7191c9-9531-4de7-af7a-3339fdaac7fa req-5e09ac07-1dc4-4f5f-968f-22500ad76079 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:50:39.101469 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-3f7191c9-9531-4de7-af7a-3339fdaac7fa req-5e09ac07-1dc4-4f5f-968f-22500ad76079 service nova] Creating event network-vif-deleted:39008b1f-a016-47f1-9046-a2c4d21ba9ca for instance f8bbe639-2f99-4da5-98e1-dbd921cd2de9 on hv-cinder-81322 Dec 15 13:50:39.106263 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-3f7191c9-9531-4de7-af7a-3339fdaac7fa req-5e09ac07-1dc4-4f5f-968f-22500ad76079 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031665 Dec 15 13:50:39.107453 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 709/1397] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:50:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:50:39.323299 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-52422ce1-ed34-4da2-8dbc-11a6d22a8198 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:50:39.323826 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-52422ce1-ed34-4da2-8dbc-11a6d22a8198 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: f8bbe639-2f99-4da5-98e1-dbd921cd2de9] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:50:39.330579 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-52422ce1-ed34-4da2-8dbc-11a6d22a8198 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:50:39.331165 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-52422ce1-ed34-4da2-8dbc-11a6d22a8198 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:50:39.332113 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-52422ce1-ed34-4da2-8dbc-11a6d22a8198 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:50:39.332570 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-52422ce1-ed34-4da2-8dbc-11a6d22a8198 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:50:39.408990 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-52422ce1-ed34-4da2-8dbc-11a6d22a8198 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484a37a0154a4f709815c5935aef8ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff117078def64108b7829db8db9baf7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:50:39.416534 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-52422ce1-ed34-4da2-8dbc-11a6d22a8198 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/f8bbe639-2f99-4da5-98e1-dbd921cd2de9" status: 200 len: 1225 microversion: 2.1 time: 0.096765 Dec 15 13:50:39.417068 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 689/1398] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:50:39 2021] GET /compute/v2.1/servers/f8bbe639-2f99-4da5-98e1-dbd921cd2de9 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:50:40.434166 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-7f714ec4-d7a1-4a73-93eb-e2fdd23aa9fa tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:50:40.434952 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-7f714ec4-d7a1-4a73-93eb-e2fdd23aa9fa tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: f8bbe639-2f99-4da5-98e1-dbd921cd2de9] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:50:40.441077 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7f714ec4-d7a1-4a73-93eb-e2fdd23aa9fa tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:50:40.441531 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7f714ec4-d7a1-4a73-93eb-e2fdd23aa9fa tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:50:40.442309 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7f714ec4-d7a1-4a73-93eb-e2fdd23aa9fa tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:50:40.442748 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7f714ec4-d7a1-4a73-93eb-e2fdd23aa9fa tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:50:40.455907 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.wsgi [None req-7f714ec4-d7a1-4a73-93eb-e2fdd23aa9fa tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] HTTP exception thrown: Instance f8bbe639-2f99-4da5-98e1-dbd921cd2de9 could not be found. Dec 15 13:50:40.456486 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-7f714ec4-d7a1-4a73-93eb-e2fdd23aa9fa tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Returning 404 to user: Instance f8bbe639-2f99-4da5-98e1-dbd921cd2de9 could not be found. {{(pid=116942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:50:40.457300 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-7f714ec4-d7a1-4a73-93eb-e2fdd23aa9fa tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/f8bbe639-2f99-4da5-98e1-dbd921cd2de9" status: 404 len: 111 microversion: 2.1 time: 0.027644 Dec 15 13:50:40.457835 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 710/1399] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:50:40 2021] GET /compute/v2.1/servers/f8bbe639-2f99-4da5-98e1-dbd921cd2de9 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:50:43.772782 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-09821fe6-187e-41ff-9ce5-a736a05ca7be tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:50:43.773300 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-09821fe6-187e-41ff-9ce5-a736a05ca7be tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: 6266e4c0-1dd9-4859-ae9c-ae17bbacae4b] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:50:43.775047 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [req-615e1ef3-0179-4449-9bbd-10d43807fb15 req-d744aa93-baa7-4b2e-b99c-1edd07ca2cc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6266e4c0-1dd9-4859-ae9c-ae17bbacae4b", "tag": "e3401a55-6804-4ee1-aba8-8e5fd04ec241"}]} {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:50:43.776418 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:50:43.776418 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: warnings.warn(msg) Dec 15 13:50:43.779945 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-09821fe6-187e-41ff-9ce5-a736a05ca7be tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:50:43.780412 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-09821fe6-187e-41ff-9ce5-a736a05ca7be tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:50:43.781257 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-09821fe6-187e-41ff-9ce5-a736a05ca7be tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:50:43.781725 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-09821fe6-187e-41ff-9ce5-a736a05ca7be tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:50:43.783472 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-615e1ef3-0179-4449-9bbd-10d43807fb15 req-d744aa93-baa7-4b2e-b99c-1edd07ca2cc5 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:50:43.783919 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [req-615e1ef3-0179-4449-9bbd-10d43807fb15 req-d744aa93-baa7-4b2e-b99c-1edd07ca2cc5 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:50:43.796678 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.compute.server_external_events [req-615e1ef3-0179-4449-9bbd-10d43807fb15 req-d744aa93-baa7-4b2e-b99c-1edd07ca2cc5 service nova] Creating event network-changed:e3401a55-6804-4ee1-aba8-8e5fd04ec241 for instance 6266e4c0-1dd9-4859-ae9c-ae17bbacae4b on hv-cinder-81322 Dec 15 13:50:43.801892 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [req-615e1ef3-0179-4449-9bbd-10d43807fb15 req-d744aa93-baa7-4b2e-b99c-1edd07ca2cc5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030501 Dec 15 13:50:43.802814 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 711/1400] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:50:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:50:43.807554 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-09821fe6-187e-41ff-9ce5-a736a05ca7be tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: 6266e4c0-1dd9-4859-ae9c-ae17bbacae4b] Going to try to terminate instance {{(pid=116941) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:50:43.888764 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-09821fe6-187e-41ff-9ce5-a736a05ca7be tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "DELETE /compute/v2.1/servers/6266e4c0-1dd9-4859-ae9c-ae17bbacae4b" status: 204 len: 0 microversion: 2.1 time: 0.119530 Dec 15 13:50:43.889402 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 690/1401] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Dec 15 13:50:43 2021] DELETE /compute/v2.1/servers/6266e4c0-1dd9-4859-ae9c-ae17bbacae4b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:50:43.898653 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-575163f8-1ede-4c60-b983-05d04d09eba3 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:50:43.899758 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-575163f8-1ede-4c60-b983-05d04d09eba3 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: 6266e4c0-1dd9-4859-ae9c-ae17bbacae4b] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:50:43.906892 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-575163f8-1ede-4c60-b983-05d04d09eba3 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:50:43.907543 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-575163f8-1ede-4c60-b983-05d04d09eba3 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:50:43.908611 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-575163f8-1ede-4c60-b983-05d04d09eba3 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:50:43.909202 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-575163f8-1ede-4c60-b983-05d04d09eba3 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:50:44.055145 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-575163f8-1ede-4c60-b983-05d04d09eba3 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484a37a0154a4f709815c5935aef8ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff117078def64108b7829db8db9baf7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:50:44.062752 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-575163f8-1ede-4c60-b983-05d04d09eba3 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/6266e4c0-1dd9-4859-ae9c-ae17bbacae4b" status: 200 len: 1577 microversion: 2.1 time: 0.168737 Dec 15 13:50:44.063729 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 712/1402] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:50:43 2021] GET /compute/v2.1/servers/6266e4c0-1dd9-4859-ae9c-ae17bbacae4b => generated 1577 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:50:45.080492 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-3d3d7169-dadb-4594-9297-b4e2169b6675 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:50:45.081166 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-3d3d7169-dadb-4594-9297-b4e2169b6675 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: 6266e4c0-1dd9-4859-ae9c-ae17bbacae4b] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:50:45.087436 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3d3d7169-dadb-4594-9297-b4e2169b6675 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:50:45.087913 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3d3d7169-dadb-4594-9297-b4e2169b6675 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:50:45.088693 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3d3d7169-dadb-4594-9297-b4e2169b6675 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:50:45.089135 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-3d3d7169-dadb-4594-9297-b4e2169b6675 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:50:45.226131 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.policy [None req-3d3d7169-dadb-4594-9297-b4e2169b6675 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484a37a0154a4f709815c5935aef8ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff117078def64108b7829db8db9baf7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116941) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:50:45.233962 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-3d3d7169-dadb-4594-9297-b4e2169b6675 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/6266e4c0-1dd9-4859-ae9c-ae17bbacae4b" status: 200 len: 1458 microversion: 2.1 time: 0.157569 Dec 15 13:50:45.234537 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 691/1403] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:50:45 2021] GET /compute/v2.1/servers/6266e4c0-1dd9-4859-ae9c-ae17bbacae4b => generated 1458 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:50:46.250652 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-7a42e845-cd39-429a-9252-f7b1f90fb73a tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:50:46.251432 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-7a42e845-cd39-429a-9252-f7b1f90fb73a tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: 6266e4c0-1dd9-4859-ae9c-ae17bbacae4b] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:50:46.257808 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7a42e845-cd39-429a-9252-f7b1f90fb73a tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:50:46.258281 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7a42e845-cd39-429a-9252-f7b1f90fb73a tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:50:46.259108 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7a42e845-cd39-429a-9252-f7b1f90fb73a tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:50:46.259553 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-7a42e845-cd39-429a-9252-f7b1f90fb73a tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:50:46.324508 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.policy [None req-7a42e845-cd39-429a-9252-f7b1f90fb73a tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484a37a0154a4f709815c5935aef8ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff117078def64108b7829db8db9baf7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116942) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:50:46.332572 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-7a42e845-cd39-429a-9252-f7b1f90fb73a tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/6266e4c0-1dd9-4859-ae9c-ae17bbacae4b" status: 200 len: 1391 microversion: 2.1 time: 0.086092 Dec 15 13:50:46.333023 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [req-58e49946-2edb-4e1c-8c53-df5a2b793746 req-150c7e0a-43fb-4c02-a701-5e6f9a22d8b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6266e4c0-1dd9-4859-ae9c-ae17bbacae4b", "name": "network-vif-deleted", "tag": "e3401a55-6804-4ee1-aba8-8e5fd04ec241"}]} {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:50:46.333496 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 713/1404] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:50:46 2021] GET /compute/v2.1/servers/6266e4c0-1dd9-4859-ae9c-ae17bbacae4b => generated 1391 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:50:46.335124 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:50:46.335124 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: warnings.warn(msg) Dec 15 13:50:46.343151 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-58e49946-2edb-4e1c-8c53-df5a2b793746 req-150c7e0a-43fb-4c02-a701-5e6f9a22d8b7 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:50:46.343595 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [req-58e49946-2edb-4e1c-8c53-df5a2b793746 req-150c7e0a-43fb-4c02-a701-5e6f9a22d8b7 service nova] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:50:46.357018 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.compute.server_external_events [req-58e49946-2edb-4e1c-8c53-df5a2b793746 req-150c7e0a-43fb-4c02-a701-5e6f9a22d8b7 service nova] Creating event network-vif-deleted:e3401a55-6804-4ee1-aba8-8e5fd04ec241 for instance 6266e4c0-1dd9-4859-ae9c-ae17bbacae4b on hv-cinder-81322 Dec 15 13:50:46.361822 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [req-58e49946-2edb-4e1c-8c53-df5a2b793746 req-150c7e0a-43fb-4c02-a701-5e6f9a22d8b7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032390 Dec 15 13:50:46.362595 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 692/1405] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 13:50:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:50:47.349714 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-c016e55a-b104-411e-9179-78928c009c75 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:50:47.350296 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-c016e55a-b104-411e-9179-78928c009c75 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: 6266e4c0-1dd9-4859-ae9c-ae17bbacae4b] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:50:47.356477 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c016e55a-b104-411e-9179-78928c009c75 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:50:47.356934 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c016e55a-b104-411e-9179-78928c009c75 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:50:47.357718 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c016e55a-b104-411e-9179-78928c009c75 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:50:47.358159 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-c016e55a-b104-411e-9179-78928c009c75 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:50:47.371832 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.wsgi [None req-c016e55a-b104-411e-9179-78928c009c75 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] HTTP exception thrown: Instance 6266e4c0-1dd9-4859-ae9c-ae17bbacae4b could not be found. Dec 15 13:50:47.372415 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-c016e55a-b104-411e-9179-78928c009c75 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Returning 404 to user: Instance 6266e4c0-1dd9-4859-ae9c-ae17bbacae4b could not be found. {{(pid=116942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:50:47.373234 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-c016e55a-b104-411e-9179-78928c009c75 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/6266e4c0-1dd9-4859-ae9c-ae17bbacae4b" status: 404 len: 111 microversion: 2.1 time: 0.027605 Dec 15 13:50:47.373769 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 714/1406] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:50:47 2021] GET /compute/v2.1/servers/6266e4c0-1dd9-4859-ae9c-ae17bbacae4b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:50:47.813978 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-374a9bc3-9760-4bfc-8f45-4495b024fa06 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:50:47.814582 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.compute.api [None req-374a9bc3-9760-4bfc-8f45-4495b024fa06 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: 599bdb62-e437-4f3c-9799-f60f3ce5392d] Fetching instance by UUID {{(pid=116941) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:50:47.820764 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-374a9bc3-9760-4bfc-8f45-4495b024fa06 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:50:47.821208 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-374a9bc3-9760-4bfc-8f45-4495b024fa06 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:50:47.821994 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-374a9bc3-9760-4bfc-8f45-4495b024fa06 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:50:47.822429 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG oslo_concurrency.lockutils [None req-374a9bc3-9760-4bfc-8f45-4495b024fa06 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:50:47.835100 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.wsgi [None req-374a9bc3-9760-4bfc-8f45-4495b024fa06 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] HTTP exception thrown: Instance 599bdb62-e437-4f3c-9799-f60f3ce5392d could not be found. Dec 15 13:50:47.835683 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-374a9bc3-9760-4bfc-8f45-4495b024fa06 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Returning 404 to user: Instance 599bdb62-e437-4f3c-9799-f60f3ce5392d could not be found. {{(pid=116941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:50:47.836499 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-374a9bc3-9760-4bfc-8f45-4495b024fa06 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "DELETE /compute/v2.1/servers/599bdb62-e437-4f3c-9799-f60f3ce5392d" status: 404 len: 111 microversion: 2.1 time: 0.027087 Dec 15 13:50:47.837028 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 693/1407] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Dec 15 13:50:47 2021] DELETE /compute/v2.1/servers/599bdb62-e437-4f3c-9799-f60f3ce5392d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:50:47.844961 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-5c5854ac-e57a-4adf-b359-b5453c1de7d2 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '>' {{(pid=116942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:50:47.845585 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.compute.api [None req-5c5854ac-e57a-4adf-b359-b5453c1de7d2 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [instance: 599bdb62-e437-4f3c-9799-f60f3ce5392d] Fetching instance by UUID {{(pid=116942) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:50:47.852039 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5c5854ac-e57a-4adf-b359-b5453c1de7d2 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:50:47.852502 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5c5854ac-e57a-4adf-b359-b5453c1de7d2 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:50:47.853298 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5c5854ac-e57a-4adf-b359-b5453c1de7d2 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:50:47.853743 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG oslo_concurrency.lockutils [None req-5c5854ac-e57a-4adf-b359-b5453c1de7d2 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Lock "b8caafff-75e8-4b27-be31-cfd5761b7f9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:50:47.867258 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.wsgi [None req-5c5854ac-e57a-4adf-b359-b5453c1de7d2 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] HTTP exception thrown: Instance 599bdb62-e437-4f3c-9799-f60f3ce5392d could not be found. Dec 15 13:50:47.867852 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: DEBUG nova.api.openstack.wsgi [None req-5c5854ac-e57a-4adf-b359-b5453c1de7d2 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Returning 404 to user: Instance 599bdb62-e437-4f3c-9799-f60f3ce5392d could not be found. {{(pid=116942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:50:47.868674 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO nova.api.openstack.requestlog [None req-5c5854ac-e57a-4adf-b359-b5453c1de7d2 tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "GET /compute/v2.1/servers/599bdb62-e437-4f3c-9799-f60f3ce5392d" status: 404 len: 111 microversion: 2.1 time: 0.027451 Dec 15 13:50:47.869216 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: [pid: 116942|app: 0|req: 715/1408] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 13:50:47 2021] GET /compute/v2.1/servers/599bdb62-e437-4f3c-9799-f60f3ce5392d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:50:49.148979 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: DEBUG nova.api.openstack.wsgi [None req-32833edc-d1ba-4567-95c9-7fb89d2808fa tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] Calling method '.version_select at 0x7ff50f68a820>' {{(pid=116941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:50:49.152814 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: ERROR oslo.messaging._drivers.impl_rabbit [None req-32833edc-d1ba-4567-95c9-7fb89d2808fa tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [b9956d66-9add-490f-96b1-3cd0faadd4a3] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 15 13:50:50.169433 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO oslo.messaging._drivers.impl_rabbit [None req-32833edc-d1ba-4567-95c9-7fb89d2808fa tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] [b9956d66-9add-490f-96b1-3cd0faadd4a3] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 51200. Dec 15 13:50:50.188444 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO nova.api.openstack.requestlog [None req-32833edc-d1ba-4567-95c9-7fb89d2808fa tempest-TestVolumeBootPattern-1072510261 tempest-TestVolumeBootPattern-1072510261-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-825054983" status: 202 len: 0 microversion: 2.1 time: 1.043203 Dec 15 13:50:50.189036 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: [pid: 116941|app: 0|req: 694/1409] 10.222.0.60 () {58 vars in 1259 bytes} [Wed Dec 15 13:50:49 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-825054983 => generated 0 bytes in 1045 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:50:54.433504 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:50:54.434079 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: Wed Dec 15 13:50:54 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 13:51:01.720903 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:51:01.721661 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: Wed Dec 15 13:51:01 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 13:52:40.998567 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:52:40.999148 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: Wed Dec 15 13:52:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 13:54:14.452572 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:54:14.453211 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: Wed Dec 15 13:54:14 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 13:54:21.739439 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:54:21.740035 dv-cinder-813227-4-iscsi devstack@n-api.service[116942]: Wed Dec 15 13:54:21 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 13:56:01.015806 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:56:01.016375 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: Wed Dec 15 13:56:01 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 13:56:06.924040 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:56:06.924582 dv-cinder-813227-4-iscsi devstack@n-api.service[116941]: Wed Dec 15 13:56:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!